00000001:02000400:2.0F:1789301965.633823:0:3299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1789301984.320511:0:3522:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1789301986.306342:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 649 MB/s 00000001:01000000:2.0:1789301986.557486:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 661 MB/s 00000001:01000000:3.0:1789301986.807226:0:3585:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5067 MB/s 00000020:02000000:1.0F:1789301987.351728:0:3614:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_ge5a3bee 00000400:02000000:0.0F:1789301988.163730:0:3629:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.109@tcp [8/256/0/180] 00008000:02000000:0.0:1789301991.714945:0:3778:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789302048.218309:0:5748:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789302061.346382:0:6507:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789302061.346388:0:6507:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789302061.346389:0:6507:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789302061.346528:0:6507:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005b15619f 00000080:02000400:2.0:1789302061.346538:0:6507:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789302061.358045:0:6507:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789302061.358055:0:6507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789302061.358078:0:6507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000003ebcc1) 00000020:00000080:2.0:1789302061.358093:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789302061.422234:0:6507:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789302061.422331:0:6507:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789302061.447724:0:6507:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789302061.448029:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789302061.448036:0:6507:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789302061.448048:0:6507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd398dcf 00000020:01000004:1.0:1789302061.448056:0:6507:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789302061.448060:0:6507:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789302061.448065:0:6507:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005b15619f from MGS 00000020:01000004:1.0:1789302061.448069:0:6507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789302061.448089:0:6507:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000000b794055) 00000020:00000080:1.0:1789302061.448101:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789302061.448301:0:6507:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005b15619f from MGS, refs=2 00080000:01000000:1.0:1789302061.448306:0:6507:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789302061.448312:0:6507:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd398ddd 00000100:00100000:1.0:1789302061.448556:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789302061.448701:0:6507:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789302061.448707:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789302061.449639:0:6507:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789302061.449648:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789302061.450615:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302061.450806:0:6507:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789302061.450812:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789302061.451520:0:6507:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789302061.451528:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789302061.451823:0:6507:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789302061.451829:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789302061.452539:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302061.452543:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302061.452544:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302061.452799:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302061.452802:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302061.452803:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302061.453560:0:6507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789302061.459066:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789302061.704580:0:6507:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3577 MB/s 00000001:01000000:1.0:1789302061.956417:0:6507:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3575 MB/s 00000001:01000000:2.0:1789302062.207658:0:6507:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 494 MB/s 00000001:01000000:2.0:1789302062.461153:0:6507:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 555 MB/s 00080000:10000000:2.0:1789302062.472962:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1789302062.484378:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789302062.499001:0:6507:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789302062.501042:0:6521:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789302062.502055:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789302062.502103:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789302062.502311:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789302062.502335:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789302062.502660:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789302062.502826:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789302062.502832:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789302062.510482:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789302062.510512:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789302062.510711:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789302062.510716:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789302062.511226:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789302062.511244:0:6507:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.109@tcp' 00000020:01000004:3.0:1789302062.511246:0:6507:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:0.0:1789302062.511503:0:6526:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1789302062.512436:0:6507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.109@tcp (typ=mgc) 00000020:00000080:3.0:1789302062.512458:0:6507:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.109@tcp (000000002492c013) 00000020:00000080:3.0:1789302062.512474:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789302062.512586:0:6507:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004c07d161@MGC192.168.203.109@tcp: add connection 192.168.203.109@tcp at head 00010000:00010000:3.0:1789302062.512746:0:6507:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.109@tcp-0 is initialized 00000040:01000000:3.0:1789302062.512760:0:6507:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.109@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789302062.515321:0:6527:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789302062.515371:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.109@tcp (uuid 483e1a3c-0199-48dd-94ee-f480825c6196) 00000020:00000080:3.0:1789302062.515393:0:6507:0:(genops.c:1384:class_connect()) connect: client 483e1a3c-0199-48dd-94ee-f480825c6196, cookie 0x1ff82925bd398deb 00000100:00080000:3.0:1789302062.515404:0:6507:0:(import.c:545:import_select_connection()) MGC192.168.203.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302062.515417:0:6507:0:(import.c:666:import_select_connection()) MGC192.168.203.109@tcp: import 000000004c07d161 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302062.515467:0:6507:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007cc475b8 x1876219121369216/t0(0) o250->MGC192.168.203.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302062.518251:0:6507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 483e1a3c-0199-48dd-94ee-f480825c6196->MGS 00000020:01000004:3.0:1789302062.518282:0:6507:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789302062.518290:0:6507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789302062.518302:0:6507:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000054808f93) 00000020:00000080:3.0:1789302062.518318:0:6507:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789302062.521105:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007cc475b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:483e1a3c-0199-48dd-94ee-f480825c6196:3644:1876219121369216:0@lo:250: 00000100:00100000:1.0:1789302062.521223:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302062.521430:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121369216 00000100:00100000:0.0:1789302062.521439:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121369216 00000100:00100000:0.0:1789302062.521486:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302062.521492:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d952e14b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1876219121369216:12345-0@lo:250: 00010000:00080000:0.0:1789302062.521515:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 483e1a3c-0199-48dd-94ee-f480825c6196@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:0.0:1789302062.521544:0:6523:0:(genops.c:1384:class_connect()) connect: client 483e1a3c-0199-48dd-94ee-f480825c6196, cookie 0x1ff82925bd398df9 00000100:00080000:0.0:1789302062.521667:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000c1469ea9 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302062.521718:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d952e14b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+5:3644:x1876219121369216:12345-0@lo:250: Request processed in 224us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302062.521726:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302062.522295:0:3644:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789302062.522310:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.109@tcp: connect to target with instance 0 00000100:00080000:1.0:1789302062.522317:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789302062.522321:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789302062.522324:0:3644:0:(import.c:65:import_set_state_nolock()) 000000004c07d161 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789302062.522327:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789302062.522330:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789302062.522334:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007cc475b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:483e1a3c-0199-48dd-94ee-f480825c6196:3644:1876219121369216:0@lo:250: 00000100:00100000:3.0:1789302062.533601:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302062.538673:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789302062.538685:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789302062.541644:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789302062.541661:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789302062.549488:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789302062.549503:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789302062.550562:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302062.550886:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789302062.550891:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789302062.551849:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789302062.551859:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789302062.595084:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789302062.595551:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789302062.595557:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789302062.596859:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789302062.596869:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789302062.597844:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302062.598005:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789302062.598010:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789302062.599003:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789302062.599013:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789302062.599921:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302062.600378:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789302062.600387:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789302062.601468:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789302062.601477:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789302062.602531:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302062.602827:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789302062.602833:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789302062.603587:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789302062.603596:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789302062.636406:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302062.636610:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789302062.636616:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789302062.641687:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789302062.641702:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789302062.643555:0:6507:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789302062.643577:0:6507:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789302062.644589:0:6507:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789302062.644619:0:6507:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789302062.644625:0:6507:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789302062.644849:0:6507:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.109@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789302062.644884:0:6507:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.109@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789302062.644889:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789302062.644891:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789302062.644892:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302062.644893:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302062.644899:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302062.644900:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302062.644901:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789302062.644902:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789302062.644904:0:6507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302062.644905:0:6507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302062.644906:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302062.644907:0:6507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789302062.644910:0:6507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789302062.644911:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789302062.644913:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789302062.644913:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302062.644914:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302062.644915:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302062.644916:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302062.644916:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789302062.644917:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789302062.644918:0:6507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302062.644919:0:6507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302062.644920:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302062.644920:0:6507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789302062.644958:0:6507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789302062.644975:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa4f7c0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369344:0@lo:253: 00000100:00100000:0.0:1789302062.645047:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302062.645194:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a35b61e going to sleep for 11 seconds 00000100:00100000:3.0:1789302062.648249:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121369344 00000100:00100000:3.0:1789302062.648265:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121369344 00000100:00100000:3.0:1789302062.648365:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302062.648374:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f9cd212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+5:6507:x1876219121369344:12345-0@lo:253: 20000000:01000000:3.0:1789302062.648433:0:6525:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789302062.648436:0:6525:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789302062.650693:0:6546:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789302062.650843:0:6525:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789302062.651148:0:6525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302062.655839:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789302062.656103:0:6525:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789302062.656108:0:6525:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789302062.656138:0:6525:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789302062.656141:0:6525:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789302062.656169:0:6525:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789302062.656362:0:6525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302062.656499:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789302062.656512:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789302062.656529:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789302062.656545:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789302062.656557:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789302062.656625:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789302062.656634:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789302062.656646:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789302062.656651:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789302062.656663:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789302062.656668:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789302062.656678:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789302062.656687:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789302062.656707:0:6525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789302062.656712:0:6525:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789302062.656719:0:6525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302062.656822:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789302062.656832:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789302062.656846:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789302062.656859:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789302062.656872:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789302062.656879:0:6525:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789302062.656902:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789302062.656909:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789302062.656920:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789302062.656934:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789302062.656947:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789302062.656955:0:6525:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789302062.656976:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789302062.656982:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789302062.657005:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789302062.657020:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789302062.657083:0:6525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789302062.657100:0:6525:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789302062.657104:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789302062.665056:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789302062.665342:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789302062.665369:0:6525:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.109@tcp for mdt 20000000:01000000:3.0:1789302062.665372:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.109@tcp (null) (null) (null) 00000040:00080000:3.0:1789302062.665388:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789302062.665395:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789302062.665408:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789302062.665413:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.109@tcp (null) (null) 00000040:00080000:3.0:1789302062.665424:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789302062.665431:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789302062.665443:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789302062.665457:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789302062.665485:0:6525:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789302062.665489:0:6525:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789302062.665492:0:6525:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789302062.665548:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789302062.665556:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789302062.665840:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789302062.665962:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789302062.665982:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789302062.665997:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789302062.666005:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789302062.666007:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789302062.666650:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789302062.666796:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789302062.666816:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789302062.666829:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1789302062.666840:0:6525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789302062.666842:0:6525:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789302062.666847:0:6525:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789302062.666849:0:6525:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789302062.666854:0:6525:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789302062.666860:0:6525:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789302062.667200:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789302062.667329:0:6525:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789302062.682474:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789302062.682510:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789302062.682525:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789302062.682543:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789302062.682564:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ec2cf085/0x1ff82925bd398e00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.682579:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec2cf085/0x1ff82925bd398e00 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.682589:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ec2cf085/0x1ff82925bd398e00 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.682611:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ec2cf085/0x1ff82925bd398e00 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.682616:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ec2cf085/0x1ff82925bd398e00 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.682623:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ec2cf085/0x1ff82925bd398e00 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.682628:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ec2cf085 already unused, calling callback (000000006b2f69eb) 00010000:00010000:0.0:1789302062.682632:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ec2cf085/0x1ff82925bd398e00 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.682638:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ec2cf085/0x1ff82925bd398e00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.682649:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ec2cf085/0x1ff82925bd398e00 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.682656:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ec2cf085/0x1ff82925bd398e00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.682661:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ec2cf085/0x1ff82925bd398e00 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789302062.682679:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789302062.691454:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f9cd212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+5:6507:x1876219121369344:12345-0@lo:253: Request processed in 43074us (46400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302062.691470:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302062.691609:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa4f7c0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369344:0@lo:253: 10000000:01000000:0.0:1789302062.691623:0:6507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789302062.691626:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789302062.691628:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789302062.691636:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302062.691637:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789302062.691638:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302062.691639:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302062.691640:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789302062.691642:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789302062.691643:0:6507:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789302062.691644:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302062.691646:0:6507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789302062.691664:0:6507:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005b15619f from lustre-MDT0000 10000000:01000000:0.0:1789302062.691692:0:6507:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789302062.691695:0:6507:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789302062.691698:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cc4ac2ab380 10000000:01000000:0.0:1789302062.691703:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789302062.691712:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cc4ac2ab380 from 1 10000000:01000000:0.0:1789302062.691715:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789302062.691759:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.691770:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.691778:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302062.691800:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa4f7c0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369472:0@lo:101: 00000100:00100000:0.0:1789302062.691838:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302062.691877:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a453282c going to sleep for 11 seconds 00000100:00100000:1.0:1789302062.692092:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121369472 00000100:00100000:1.0:1789302062.692099:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121369472 00000100:00100000:1.0:1789302062.692161:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302062.692169:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000903b4b89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+5:6507:x1876219121369472:12345-0@lo:101: 00010000:00010000:1.0:1789302062.692181:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302062.692194:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000b79707/0x1ff82925bd398e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398e07 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302062.692216:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000b79707/0x1ff82925bd398e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398e07 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302062.692226:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000b79707/0x1ff82925bd398e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398e07 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302062.692234:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000b79707, rc 0) 00000100:00100000:1.0:1789302062.692278:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000903b4b89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+6:6507:x1876219121369472:12345-0@lo:101: Request processed in 110us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302062.692295:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302062.692371:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa4f7c0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369472:0@lo:101: 00010000:00010000:2.0:1789302062.692383:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.692402:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302062.692488:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d4a0e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369600:0@lo:501: 00000100:00100000:2.0:1789302062.692528:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302062.692551:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006c791b0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302062.692670:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121369600 00000100:00100000:3.0:1789302062.692676:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121369600 00000100:00100000:3.0:1789302062.692708:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302062.692714:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dbfd7e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+6:6507:x1876219121369600:12345-0@lo:501: 00000100:00100000:3.0:1789302062.692793:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dbfd7e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+6:6507:x1876219121369600:12345-0@lo:501: Request processed in 80us (265us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302062.692800:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789302062.692971:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d4a0e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369600:0@lo:501: 10000000:01000000:2.0:1789302062.693001:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789302062.693020:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.693027:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302062.693035:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cc4b863d000 10000000:01000000:2.0:1789302062.693038:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789302062.693042:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cc4b863d000 10000000:01000000:2.0:1789302062.693044:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789302062.693046:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cc4b863d000 from 1 10000000:01000000:2.0:1789302062.693048:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789302062.693065:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 000000001d7c0d6a/0x1ff82925bd398e15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.693071:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 000000001d7c0d6a/0x1ff82925bd398e15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.693079:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 000000001d7c0d6a/0x1ff82925bd398e15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302062.693103:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d4a0e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369728:0@lo:101: 00000100:00100000:2.0:1789302062.693159:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302062.693176:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006c791b0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302062.693272:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121369728 00000100:00100000:0.0:1789302062.693278:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121369728 00000100:00100000:0.0:1789302062.693307:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789302062.693313:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f13e6604 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+6:6507:x1876219121369728:12345-0@lo:101: 00010000:00010000:0.0:1789302062.693320:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302062.693335:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000478e2b83/0x1ff82925bd398e1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398e15 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.693350:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000478e2b83/0x1ff82925bd398e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398e15 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.693358:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000478e2b83/0x1ff82925bd398e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398e15 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.693365:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000478e2b83, rc 0) 00000100:00100000:0.0:1789302062.693406:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f13e6604 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+7:6507:x1876219121369728:12345-0@lo:101: Request processed in 93us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302062.693411:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302062.693527:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d4a0e3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369728:0@lo:101: 00010000:00010000:3.0:1789302062.693538:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 000000001d7c0d6a/0x1ff82925bd398e15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302062.693546:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 000000001d7c0d6a/0x1ff82925bd398e15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302062.693569:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789302062.693588:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 000000001d7c0d6a/0x1ff82925bd398e15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302062.693596:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 000000001d7c0d6a/0x1ff82925bd398e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302062.693602:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789302062.693605:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789302062.693614:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cc4b863d000 10000000:01000000:3.0:1789302062.693616:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789302062.693619:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789302062.693621:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789302062.693636:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302062.693643:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302062.693649:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302062.693660:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369856:0@lo:101: 00000100:00100000:3.0:1789302062.693693:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302062.693716:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b5bc3ec going to sleep for 11 seconds 00000100:00100000:1.0:1789302062.693780:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121369856 00000100:00100000:1.0:1789302062.693784:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121369856 00000100:00100000:1.0:1789302062.693804:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789302062.693810:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e65abd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+7:6507:x1876219121369856:12345-0@lo:101: 00010000:00010000:1.0:1789302062.693817:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302062.693835:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000379f50e7/0x1ff82925bd398e2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398e23 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302062.693851:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000379f50e7/0x1ff82925bd398e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398e23 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302062.693857:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000379f50e7/0x1ff82925bd398e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398e23 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302062.693863:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000379f50e7, rc 0) 00000100:00100000:1.0:1789302062.693897:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e65abd29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+8:6507:x1876219121369856:12345-0@lo:101: Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302062.693902:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302062.694029:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369856:0@lo:101: 00010000:00010000:3.0:1789302062.694038:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302062.694057:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302062.694100:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369984:0@lo:501: 00000100:00100000:3.0:1789302062.694156:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302062.694174:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b5bc3ec going to sleep for 11 seconds 00000100:00100000:2.0:1789302062.694247:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121369984 00000100:00100000:2.0:1789302062.694253:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121369984 00000100:00100000:2.0:1789302062.694272:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302062.694278:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005694323d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+8:6507:x1876219121369984:12345-0@lo:501: 00000100:00100000:2.0:1789302062.694370:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005694323d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+9:6507:x1876219121369984:12345-0@lo:501: Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302062.694377:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789302062.694467:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121369984:0@lo:501: 00000100:00100000:3.0:1789302062.694490:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121370112:0@lo:503: 00000100:00100000:3.0:1789302062.694524:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302062.694542:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b5bc3ec going to sleep for 11 seconds 00000100:00100000:2.0:1789302062.694632:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121370112 00000100:00100000:2.0:1789302062.694636:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121370112 00000100:00100000:2.0:1789302062.694651:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302062.694656:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cbf5ebf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+9:6507:x1876219121370112:12345-0@lo:503: 00000100:00100000:2.0:1789302062.694733:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cbf5ebf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+9:6507:x1876219121370112:12345-0@lo:503: Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302062.694739:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789302062.695047:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121370112:0@lo:503: 00000100:00100000:3.0:1789302062.695549:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:6552:1876219121370240:0@lo:502: 00000100:00100000:3.0:1789302062.695590:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302062.695612:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set 000000002319ff6c going to sleep for 11 seconds 00000100:00100000:2.0:1789302062.695688:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121370240 00000100:00100000:2.0:1789302062.695694:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121370240 00000100:00100000:2.0:1789302062.695726:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302062.695732:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007c5bb589 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+9:6552:x1876219121370240:12345-0@lo:502: 00000100:00100000:2.0:1789302062.695961:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007c5bb589 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+9:6552:x1876219121370240:12345-0@lo:502: Request processed in 228us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302062.695968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789302062.696050:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:6552:1876219121370240:0@lo:502: 00000020:01000000:3.0:1789302062.696073:0:6552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302062.696083:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302062.696085:0:6552:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789302062.696090:0:6552:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789302062.696093:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302062.696106:0:6552:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000a550f0a) 00000020:00000080:3.0:1789302062.696275:0:6552:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789302062.696283:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789302062.696358:0:6552:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789302062.696365:0:6552:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd398e38 00000020:00000080:3.0:1789302062.696959:0:6552:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789302062.696969:0:6552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302062.696973:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302062.696975:0:6552:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789302062.696977:0:6552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302062.696981:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302062.696982:0:6552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789302062.696985:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302062.696994:0:6552:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f1bbf7fd) 00000020:00000080:3.0:1789302062.697006:0:6552:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789302062.697010:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789302062.697012:0:6552:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789302062.697014:0:6552:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789302062.697020:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789302062.697078:0:6552:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005b15619f from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789302062.697098:0:6552:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000fda2678d) 00000020:00000080:3.0:1789302062.697107:0:6552:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789302062.697212:0:6552:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789302062.697218:0:6552:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd398e4d 00000020:00000080:3.0:1789302062.697318:0:6552:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789302062.697324:0:6552:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789302062.697328:0:6552:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1ff82925bd398e54 00080000:01000000:3.0:1789302062.697333:0:6552:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789302062.697336:0:6552:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd398e5b 00080000:10000000:3.0:1789302062.697794:0:6552:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789302062.697937:0:6552:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789302062.702927:0:6552:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789302062.831543:0:6552:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789302062.832085:0:6552:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789302062.836218:0:6552:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789302062.836537:0:6552:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789302062.839810:0:6552:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ca0df309) 00000020:00000080:0.0:1789302062.839833:0:6552:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789302062.839947:0:6552:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789302062.839954:0:6552:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd398e69 00000020:00000080:0.0:1789302062.840414:0:6552:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789302062.841332:0:6552:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1789302062.846828:0:6552:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1789302062.851573:0:6552:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1789302062.854011:0:6552:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1789302062.860066:0:6552:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1789302062.863815:0:6552:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1789302062.865873:0:6552:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1ff82925bd398e70 00000020:00000080:2.0:1789302062.866343:0:6552:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789302062.866355:0:6552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302062.866360:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302062.866362:0:6552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789302062.866374:0:6552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302062.866378:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302062.866379:0:6552:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789302062.866382:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789302062.866384:0:6552:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789302062.866386:0:6552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302062.866388:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302062.866390:0:6552:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789302062.866392:0:6552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302062.866396:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302062.866397:0:6552:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789302062.866400:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789302062.866444:0:6552:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789302062.866492:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eebaffd7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:6552:1876219121370368:0@lo:502: 00000100:00100000:2.0:1789302062.866565:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302062.866609:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d42d5ec going to sleep for 11 seconds 00000100:00100000:0.0:1789302062.866738:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121370368 00000100:00100000:0.0:1789302062.866756:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121370368 00000100:00100000:0.0:1789302062.866800:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789302062.866809:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f40949a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+9:6552:x1876219121370368:12345-0@lo:502: 00000100:00100000:0.0:1789302062.866922:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f40949a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+9:6552:x1876219121370368:12345-0@lo:502: Request processed in 114us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302062.866930:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302062.867014:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eebaffd7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:6552:1876219121370368:0@lo:502: 00000020:01000000:1.0:1789302062.867037:0:6552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302062.867042:0:6552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302062.867043:0:6552:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789302062.867047:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789302062.867214:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789302062.867232:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789302062.867252:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.867263:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302062.867271:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b863d000 from 1 10000000:01000000:0.0:1789302062.867273:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789302062.867296:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.867304:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.867312:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302062.867324:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121370496:0@lo:101: 00000100:00100000:0.0:1789302062.867350:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302062.867386:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121370496 00000100:00100000:0.0:1789302062.867390:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121370496 00000100:00100000:0.0:1789302062.867410:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302062.867416:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001fc54b89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+9:6507:x1876219121370496:12345-0@lo:101: 00010000:00010000:0.0:1789302062.867423:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302062.867433:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016fdabff/0x1ff82925bd398e7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398e77 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.867462:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016fdabff/0x1ff82925bd398e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398e77 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.867480:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016fdabff/0x1ff82925bd398e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398e77 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.867488:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016fdabff, rc 0) 00000100:00100000:0.0:1789302062.867511:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001fc54b89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+10:6507:x1876219121370496:12345-0@lo:101: Request processed in 95us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302062.867516:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302062.867543:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d57ec379 going to sleep for 11 seconds 00000100:00100000:0.0:1789302062.867554:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121370496:0@lo:101: 00010000:00010000:0.0:1789302062.867565:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.867572:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302062.868135:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121370624:0@lo:256: 00000100:00100000:0.0:1789302062.868175:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302062.868200:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121370624 00000100:00100000:0.0:1789302062.868205:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121370624 00000100:00100000:0.0:1789302062.868222:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302062.868227:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005245c1d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+10:6507:x1876219121370624:12345-0@lo:256: 20000000:01000000:0.0:1789302062.868239:0:6524:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789302062.868244:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789302062.868293:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005245c1d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+10:6507:x1876219121370624:12345-0@lo:256: Request processed in 66us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302062.868300:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302062.868972:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d57ec379 going to sleep for 11 seconds 00000100:00100000:0.0:1789302062.868992:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121370624:0@lo:256: 10000000:01000000:0.0:1789302062.869572:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789302062.869581:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.869592:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302062.869600:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b863d000 from 1 10000000:01000000:0.0:1789302062.869602:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302062.869632:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.869638:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.869646:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302062.869661:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121370752:0@lo:101: 00000100:00100000:0.0:1789302062.869703:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302062.869742:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121370752 00000100:00100000:0.0:1789302062.869759:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121370752 00000100:00100000:0.0:1789302062.869792:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302062.869799:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000762322d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+10:6507:x1876219121370752:12345-0@lo:101: 00010000:00010000:0.0:1789302062.869810:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302062.869822:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad7ae9ec/0x1ff82925bd398e8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398e85 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.869853:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad7ae9ec/0x1ff82925bd398e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398e85 expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.869862:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad7ae9ec/0x1ff82925bd398e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398e85 expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.869870:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad7ae9ec, rc 0) 00000100:00100000:0.0:1789302062.869895:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000762322d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+11:6507:x1876219121370752:12345-0@lo:101: Request processed in 97us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302062.869902:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302062.869928:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d0bd1b73 going to sleep for 11 seconds 00000100:00100000:0.0:1789302062.869941:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121370752:0@lo:101: 00010000:00010000:0.0:1789302062.869952:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.869960:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302062.870005:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121370880:0@lo:501: 00000100:00100000:0.0:1789302062.870030:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302062.870048:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121370880 00000100:00100000:0.0:1789302062.870052:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121370880 00000100:00100000:0.0:1789302062.870072:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302062.870077:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bbb1ba94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+11:6507:x1876219121370880:12345-0@lo:501: 00000100:00100000:0.0:1789302062.870233:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bbb1ba94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+11:6507:x1876219121370880:12345-0@lo:501: Request processed in 155us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302062.870240:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302062.870298:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d0bd1b73 going to sleep for 11 seconds 00000100:00100000:0.0:1789302062.870311:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121370880:0@lo:501: 00000100:00100000:0.0:1789302062.870332:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121371008:0@lo:503: 00000100:00100000:0.0:1789302062.870366:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302062.870384:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121371008 00000100:00100000:0.0:1789302062.870387:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121371008 00000100:00100000:0.0:1789302062.870406:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302062.870410:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089c0d90a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+11:6507:x1876219121371008:12345-0@lo:503: 00000040:00080000:0.0:1789302062.870440:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789302062.870468:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089c0d90a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+11:6507:x1876219121371008:12345-0@lo:503: Request processed in 58us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302062.870475:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302062.870503:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d0bd1b73 going to sleep for 11 seconds 00000100:00100000:0.0:1789302062.870514:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121371008:0@lo:503: 00000040:00080000:2.0:1789302062.872899:0:6556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789302062.873087:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789302062.873107:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302062.874584:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.874600:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302062.874664:0:6507:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789302062.874667:0:6507:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cc4b863d000 10000000:01000000:0.0:1789302062.874670:0:6507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cc4b863d000 10000000:01000000:0.0:1789302062.874673:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789302062.874679:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4b863d000 from 1 10000000:01000000:0.0:1789302062.874682:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789302062.874726:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.874734:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302062.874744:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302062.874775:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121371136:0@lo:101: 00000100:00100000:0.0:1789302062.874841:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302062.874899:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d0bd1b73 going to sleep for 11 seconds 00000100:00100000:2.0:1789302062.875470:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121371136 00000100:00100000:2.0:1789302062.875480:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121371136 00000100:00100000:2.0:1789302062.875523:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789302062.875532:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003929bae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+11:6507:x1876219121371136:12345-0@lo:101: 00010000:00010000:2.0:1789302062.875544:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302062.875559:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001a5fd806/0x1ff82925bd398e9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398e93 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.875580:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a5fd806/0x1ff82925bd398e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398e93 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.875599:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001a5fd806/0x1ff82925bd398e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398e93 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.875606:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001a5fd806, rc 0) 00000100:00100000:2.0:1789302062.875650:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003929bae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+12:6507:x1876219121371136:12345-0@lo:101: Request processed in 120us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302062.875656:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789302062.876509:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0e0e702 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121371136:0@lo:101: 00010000:00010000:3.0:1789302062.876529:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302062.876547:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302062.876625:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121371264:0@lo:501: 00000100:00100000:3.0:1789302062.876663:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302062.876694:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a08c861d going to sleep for 11 seconds 00000100:00100000:2.0:1789302062.876866:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121371264 00000100:00100000:2.0:1789302062.876872:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121371264 00000100:00100000:2.0:1789302062.876904:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302062.876910:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062dad60a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:6507:x1876219121371264:12345-0@lo:501: 00000100:00100000:2.0:1789302062.877027:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062dad60a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:6507:x1876219121371264:12345-0@lo:501: Request processed in 118us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302062.877034:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789302062.877505:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121371264:0@lo:501: 00000100:00100000:3.0:1789302062.877546:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121371392:0@lo:503: 00000100:00100000:3.0:1789302062.877587:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302062.877611:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a08c861d going to sleep for 11 seconds 00000100:00100000:2.0:1789302062.877681:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121371392 00000100:00100000:2.0:1789302062.877687:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121371392 00000100:00100000:2.0:1789302062.877718:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789302062.877725:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f2d3bd36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:6507:x1876219121371392:12345-0@lo:503: 00000100:00100000:2.0:1789302062.877815:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f2d3bd36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:6507:x1876219121371392:12345-0@lo:503: Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302062.877822:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789302062.877895:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121371392:0@lo:503: 00000100:00100000:3.0:1789302062.879720:0:6557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:6557:1876219121371520:0@lo:502: 00000100:00100000:3.0:1789302062.879808:0:6557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302062.879847:0:6557:0:(client.c:2716:ptlrpc_set_wait()) set 000000000f5d5238 going to sleep for 11 seconds 00000100:00100000:2.0:1789302062.879902:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121371520 00000100:00100000:2.0:1789302062.879910:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121371520 00000100:00100000:2.0:1789302062.879955:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302062.879963:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d29bce4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+12:6557:x1876219121371520:12345-0@lo:502: 00000100:00100000:2.0:1789302062.880068:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d29bce4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+12:6557:x1876219121371520:12345-0@lo:502: Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302062.880081:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789302062.880236:0:6557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:6557:1876219121371520:0@lo:502: 00000020:01000004:3.0:1789302062.880291:0:6557:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789302062.880305:0:6557:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000074100c32) 00000020:00000080:3.0:1789302062.880320:0:6557:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789302062.880549:0:6557:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005b15619f from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789302062.880553:0:6557:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005b15619f from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789302062.880556:0:6557:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005b15619f 4 00010000:00080000:3.0:1789302062.880581:0:6557:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000003e44fb0@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.109@tcp at head 00010000:00010000:3.0:1789302062.882675:0:6557:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789302062.882917:0:6557:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789302062.882955:0:6557:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789302062.882973:0:6557:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1ff82925bd398ea8 00000100:00080000:3.0:1789302062.882982:0:6557:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302062.882993:0:6557:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000003e44fb0 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302062.883023:0:6557:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000014deb788 x1876219121371648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302062.883050:0:6557:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789302062.883393:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876219121371648:0@lo:38: 00000100:00100000:1.0:1789302062.883466:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302062.883620:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121371648 00000100:00100000:0.0:1789302062.883627:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121371648 00000100:00100000:0.0:1789302062.883662:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302062.883668:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000542e7274 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876219121371648:12345-0@lo:38: 00000100:00100000:0.0:1789302062.883721:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000542e7274 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876219121371648:12345-0@lo:38: Request processed in 51us (255us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789302062.883727:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302062.883980:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789302062.883987:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000003e44fb0 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789302062.883991:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789302062.883994:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876219121371648:0@lo:38: 00000100:00100000:2.0:1789302062.886679:0:6557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000001601fd pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:6557:1876219121371776:0@lo:502: 00000100:00100000:2.0:1789302062.886766:0:6557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302062.886921:0:6557:0:(client.c:2716:ptlrpc_set_wait()) set 000000002319ff6c going to sleep for 11 seconds 00000100:00100000:1.0:1789302062.890632:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121371776 00000100:00100000:1.0:1789302062.890645:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121371776 00000100:00100000:1.0:1789302062.890735:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789302062.890744:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002dbfc67a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+12:6557:x1876219121371776:12345-0@lo:502: 00000100:00100000:1.0:1789302062.890905:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002dbfc67a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+12:6557:x1876219121371776:12345-0@lo:502: Request processed in 162us (4139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302062.890912:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302062.890995:0:6557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000001601fd pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:6557:1876219121371776:0@lo:502: 00000040:00080000:3.0:1789302062.891028:0:6557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789302062.892336:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789302062.892362:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302062.892474:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.892486:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789302062.892538:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789302062.892540:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789302062.892541:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302062.892542:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302062.892544:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302062.892545:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302062.892546:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302062.892547:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789302062.892549:0:6507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302062.892550:0:6507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302062.892551:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302062.892553:0:6507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302062.892556:0:6507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789302062.892559:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302062.892560:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789302062.892561:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302062.892562:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302062.892563:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302062.892564:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302062.892565:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302062.892566:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789302062.892567:0:6507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302062.892572:0:6507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302062.892573:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302062.892574:0:6507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302062.892595:0:6507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789302062.892608:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d999f1bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121371904:0@lo:253: 00000100:00100000:2.0:1789302062.892661:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302062.892704:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edf6fddb going to sleep for 11 seconds 00000100:00100000:3.0:1789302062.892758:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121371904 00000100:00100000:3.0:1789302062.892764:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121371904 00000100:00100000:3.0:1789302062.892802:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789302062.892809:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf5c9307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:6507:x1876219121371904:12345-0@lo:253: 20000000:01000000:3.0:1789302062.892831:0:6523:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789302062.892842:0:6523:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789302062.902864:0:6523:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789302062.902889:0:6523:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789302062.903298:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf5c9307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:6507:x1876219121371904:12345-0@lo:253: Request processed in 10485us (10633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302062.903311:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789302062.903462:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d999f1bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:6507:1876219121371904:0@lo:253: 10000000:01000000:0.0:1789302062.903475:0:6507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789302062.903478:0:6507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789302062.903479:0:6507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789302062.903480:0:6507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302062.903481:0:6507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302062.903482:0:6507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302062.903483:0:6507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302062.903485:0:6507:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789302062.903486:0:6507:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789302062.903487:0:6507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302062.903488:0:6507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302062.903489:0:6507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302062.903502:0:6507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789302062.903514:0:6507:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789302062.903898:0:6546:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789302062.903904:0:6546:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789302062.903922:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.903944:0:6546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000016fdabff/0x1ff82925bd398e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398e77 expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.903950:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.903983:0:6546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000016fdabff/0x1ff82925bd398e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398e77 expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.903998:0:6546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000016fdabff/0x1ff82925bd398e7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398e77 expref: 11 pid: 6524 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302062.904009:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040b46c72 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121372032:0@lo:104: 00000100:00100000:2.0:1789302062.904045:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302062.904096:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b64c61a going to sleep for 11 seconds 00000100:00100000:3.0:1789302062.907030:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121372032 00000100:00100000:3.0:1789302062.907045:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121372032 00000100:00100000:3.0:1789302062.907104:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302062.907127:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001a5c8396 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:6546:x1876219121372032:12345-0@lo:104: 00010000:00010000:3.0:1789302062.907156:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302062.907238:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302062.907244:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001a5c8396 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:6546:x1876219121372032:12345-0@lo:104: Request processed in 133us (3199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302062.907251:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302062.907886:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040b46c72 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121372032:0@lo:104: 00010000:00010000:2.0:1789302062.907908:0:6546:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.907927:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302062.907939:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.907946:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000012bc8936 already unused, calling callback (0000000091532f94) 10000000:00010000:2.0:1789302062.907949:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.907956:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302062.907962:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302062.907968:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302062.908001:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908008:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302062.908033:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908040:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398e77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e7e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908058:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302062.908060:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302062.908062:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302062.908232:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040b46c72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121372160:0@lo:103: 00000100:00100000:3.0:1789302062.908275:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302062.908626:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121372160 00000100:00100000:2.0:1789302062.908633:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121372160 00010000:00010000:2.0:1789302062.908653:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000016fdabff/0x1ff82925bd398e7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398e77 expref: 12 pid: 6524 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302062.908696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302062.908704:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014deb788 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+12:3646:x1876219121372160:12345-0@lo:103: 00010000:00010000:2.0:1789302062.908715:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302062.908719:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000016fdabff/0x1ff82925bd398e7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398e77 expref: 12 pid: 6524 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908729:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000016fdabff/0x1ff82925bd398e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398e77 expref: 12 pid: 6524 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908741:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000016fdabff/0x1ff82925bd398e7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398e77 expref: 12 pid: 6524 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908764:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908771:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789302062.908785:0:6515:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004881399s 00010000:00010000:2.0:1789302062.908788:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908794:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908799:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908804:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908816:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dd64402d already unused, calling callback (000000006b2f69eb) 00010000:00010000:2.0:1789302062.908820:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908826:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908837:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302062.908845:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302062.908882:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014deb788 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+11:3646:x1876219121372160:12345-0@lo:103: Request processed in 180us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302062.908889:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302062.908920:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040b46c72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121372160:0@lo:103: 00010000:00010000:1.0:1789302062.908974:0:6546:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302062.908982:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302062.908987:0:6546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dd64402d/0x1ff82925bd398eaf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789302062.912819:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1789302062.912988:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789302062.913930:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1789302062.914245:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789302062.914634:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1789302062.915827:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789302062.917945:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1789302062.919548:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789302062.919902:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1789302062.920064:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789302062.923897:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1789302062.924088:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1789302062.940761:0:6507:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:0.0:1789302062.963402:0:6562:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789302062.963409:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789302062.964290:0:6507:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789302062.964674:0:6563:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789302062.967699:0:6507:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789302062.967833:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789302062.968258:0:6507:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789302062.968265:0:6507:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789302062.968376:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302062.969308:0:6507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789302062.974901:0:6507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789302062.974990:0:6507:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789302062.978805:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789302062.979480:0:6507:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1789302062.980040:0:6563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1789302062.983304:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789302062.983897:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789302062.984060:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789302062.984304:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789302062.984561:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789302062.984686:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789302062.984846:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789302062.984982:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789302062.985952:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789302062.986104:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789302062.986993:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789302062.987171:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789302062.987318:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789302062.987779:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789302062.987942:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789302062.988077:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789302062.988590:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000040:00080000:1.0:1789302062.988639:0:6563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789302062.988714:0:6563:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789302062.988719:0:6563:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1789302062.988774:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789302062.988908:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789302062.989040:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789302062.993284:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789302062.993996:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789302062.994210:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789302062.994762:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789302062.994916:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789302062.995063:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789302062.995339:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789302062.995557:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789302062.995690:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789302062.995859:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789302062.996016:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789302062.997041:0:6507:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789302062.997914:0:6507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1789302063.001310:0:6507:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789302063.001349:0:6507:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadc441c8f988 00100000:10000000:1.0:1789302063.001357:0:6507:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789302063.002090:0:6507:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789302063.002104:0:6507:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.109@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789302063.002273:0:6507:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789302063.002297:0:6507:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789302063.003161:0:6507:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789302063.003332:0:6507:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789302063.508248:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302064.532382:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302065.562367:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302066.580663:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302067.605615:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789302067.617766:0:6808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789302068.309230:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789302068.309239:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789302068.309241:0:37:0:(import.c:65:import_set_state_nolock()) 0000000003e44fb0 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302068.309257:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000003e44fb0 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302068.309279:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ca2b9e79 x1876219121372416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789302068.309315:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca2b9e79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876219121372416:0@lo:38: 00000100:00100000:3.0:1789302068.309374:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302068.309463:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121372416 00000100:00100000:3.0:1789302068.309470:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121372416 00000100:00100000:3.0:1789302068.309500:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302068.309506:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f06ff7a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121372416:12345-0@lo:38: 00010000:00080000:3.0:1789302068.309528:0:6532:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:3.0:1789302068.309587:0:6532:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1ff82925bd398eb6 00000004:00100000:3.0:1789302068.309629:0:6532:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789302068.309766:0:6532:0:(import.c:65:import_set_state_nolock()) 00000000f49ec578 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302068.309814:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f06ff7a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876219121372416:12345-0@lo:38: Request processed in 307us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302068.309821:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789302068.309855:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ca2b9e79 x1876219121372416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789302068.309870:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789302068.309876:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789302068.309879:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789302068.309881:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000003e44fb0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789302068.309886:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca2b9e79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876219121372416:0@lo:38: 00000100:00100000:0.0:1789302068.310359:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026f32021 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121372288:0@lo:400: 00000100:00100000:0.0:1789302068.310408:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302068.312155:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121372288 00000100:00100000:3.0:1789302068.312167:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121372288 00000100:00100000:3.0:1789302068.312222:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789302068.312229:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004223eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+11:3647:x1876219121372288:12345-0@lo:400: 00000100:00100000:3.0:1789302068.312294:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004223eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+11:3647:x1876219121372288:12345-0@lo:400: Request processed in 65us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302068.312300:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:01000000:0.0:1789302068.313676:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789302068.313683:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b863d000 from 3 10000000:01000000:0.0:1789302068.313687:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789302068.313734:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302068.313747:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302068.313757:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302068.313776:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5d06137 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121372544:0@lo:101: 00000100:00100000:0.0:1789302068.313829:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302068.313872:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 00000000134526f4 going to sleep for 11 seconds 00000100:00100000:0.0:1789302068.313903:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026f32021 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121372288:0@lo:400: 00000100:00100000:1.0:1789302068.314155:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121372544 00000100:00100000:1.0:1789302068.314169:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121372544 00000100:00100000:1.0:1789302068.314220:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302068.314228:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c4ef214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+11:6527:x1876219121372544:12345-0@lo:101: 00010000:00010000:1.0:1789302068.314239:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302068.314252:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d5b19476/0x1ff82925bd398ec4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398ebd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302068.314273:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d5b19476/0x1ff82925bd398ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398ebd expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302068.314282:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d5b19476/0x1ff82925bd398ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398ebd expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302068.314291:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d5b19476, rc 0) 00000100:00100000:1.0:1789302068.314327:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c4ef214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:6527:x1876219121372544:12345-0@lo:101: Request processed in 101us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302068.314334:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789302068.314432:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5d06137 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121372544:0@lo:101: 00010000:00010000:0.0:1789302068.314445:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302068.314454:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302068.314507:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5d06137 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121372672:0@lo:256: 00000100:00100000:0.0:1789302068.314538:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302068.314567:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 00000000134526f4 going to sleep for 11 seconds 00000100:00100000:1.0:1789302068.314683:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121372672 00000100:00100000:1.0:1789302068.314688:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121372672 00000100:00100000:1.0:1789302068.314725:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302068.314731:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000421bba02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+12:6527:x1876219121372672:12345-0@lo:256: 20000000:01000000:1.0:1789302068.314912:0:6524:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789302068.314929:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789302068.314933:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789302068.315020:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000421bba02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+12:6527:x1876219121372672:12345-0@lo:256: Request processed in 289us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302068.315028:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789302068.315095:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5d06137 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121372672:0@lo:256: 10000000:01000000:0.0:1789302068.315175:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789302068.315181:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302068.315188:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1789302068.400675:0:6860:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789302068.400859:0:6860:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789302068.629233:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302069.652394:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302070.676664:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789302071.046509:0:6961:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789302071.046688:0:6961:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789302071.700251:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302072.726093:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302073.430709:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121372928:0@lo:400: 00000100:00100000:0.0:1789302073.430773:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302073.430781:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302073.430790:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca2b9e79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121372800:0@lo:400: 00000100:00100000:0.0:1789302073.430837:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302073.430854:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121372928 00000100:00100000:3.0:1789302073.430861:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121372928 00000100:00100000:0.0:1789302073.430881:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121372800 00000100:00100000:0.0:1789302073.430887:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121372800 00000100:00100000:3.0:1789302073.430915:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302073.430925:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000085cbd2da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121372928:12345-0@lo:400: 00000100:00100000:0.0:1789302073.430931:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789302073.430941:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001d253b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+12:3647:x1876219121372800:12345-0@lo:400: 00000100:00100000:3.0:1789302073.430976:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000085cbd2da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121372928:12345-0@lo:400: Request processed in 53us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302073.430985:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302073.430993:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001d253b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+12:3647:x1876219121372800:12345-0@lo:400: Request processed in 53us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302073.431000:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789302073.431025:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fab6e680 x1876219121372928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302073.431039:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121372928:0@lo:400: 00000100:00100000:0.0:1789302073.431067:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca2b9e79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121372800:0@lo:400: 00010000:00010000:2.0:1789302073.754767:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302074.772952:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302075.797357:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302076.820406:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302077.844337:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302078.548785:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a2043f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121373056:0@lo:400: 00000100:00100000:1.0:1789302078.548849:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302078.548914:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121373056 00000100:00100000:1.0:1789302078.548921:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121373056 00000100:00100000:1.0:1789302078.548953:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789302078.548959:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ab94309a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+12:3646:x1876219121373056:12345-0@lo:400: 00000100:00100000:1.0:1789302078.548998:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ab94309a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+12:3646:x1876219121373056:12345-0@lo:400: Request processed in 40us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302078.549005:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789302078.549042:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a2043f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121373056:0@lo:400: 00000100:00100000:1.0:1789302078.549072:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a2043f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121373184:0@lo:400: 00000100:00100000:1.0:1789302078.549094:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302078.549213:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121373184 00000100:00100000:1.0:1789302078.549380:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121373184 00000100:00100000:1.0:1789302078.549410:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302078.549415:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f1d51fde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121373184:12345-0@lo:400: 00000100:00100000:1.0:1789302078.549448:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f1d51fde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121373184:12345-0@lo:400: Request processed in 33us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302078.549453:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789302078.549480:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006a2043f4 x1876219121373184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302078.549491:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a2043f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121373184:0@lo:400: 00010000:00010000:3.0:1789302078.868900:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302079.893822:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302080.922502:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789302081.197731:0:7460:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789302081.197735:0:7460:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789302081.197736:0:7460:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789302081.197870:0:7460:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a06091f1 00000020:01000004:2.0:1789302081.197886:0:7460:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789302081.197897:0:7460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789302081.197909:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000052bf0959) 00000020:00000080:2.0:1789302081.197924:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789302081.310297:0:7460:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789302081.310443:0:7460:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1789302081.344604:0:7460:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789302081.344823:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789302081.344836:0:7460:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789302081.344845:0:7460:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd398ed2 00000020:01000004:0.0:1789302081.344852:0:7460:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789302081.344868:0:7460:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.109@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789302081.344871:0:7460:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789302081.344875:0:7460:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789302081.344898:0:7460:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789302081.344902:0:7460:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.109@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789302081.361897:0:7460:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789302081.361938:0:7460:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.109@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789302081.361942:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789302081.361943:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789302081.361945:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302081.361946:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302081.361948:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302081.361949:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302081.361950:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302081.361952:0:7460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302081.361953:0:7460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302081.361954:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302081.361956:0:7460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789302081.361959:0:7460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789302081.361961:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302081.361962:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789302081.361963:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302081.361964:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302081.361965:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302081.361966:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302081.361967:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302081.361968:0:7460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302081.361969:0:7460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302081.361970:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302081.361971:0:7460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789302081.361995:0:7460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789302081.362012:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040b46c72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121373312:0@lo:253: 00000100:00100000:2.0:1789302081.362082:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302081.362265:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000004a5063f7 going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.362670:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121373312 00000100:00100000:0.0:1789302081.362678:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121373312 00000100:00100000:0.0:1789302081.362773:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302081.362781:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001153ae90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:7460:x1876219121373312:12345-0@lo:253: 20000000:01000000:0.0:1789302081.362811:0:6523:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789302081.362814:0:6523:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789302081.362818:0:6523:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789302081.362821:0:6523:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789302081.362853:0:6523:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1789302081.363045:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302081.363210:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789302081.363224:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789302081.363241:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789302081.363257:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789302081.363272:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789302081.363429:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1789302081.363438:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1789302081.363451:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1789302081.363459:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1789302081.363472:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1789302081.363478:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1789302081.363489:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789302081.363503:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789302081.363630:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1789302081.363641:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.109@tcp (null) (null) (null) 00000040:00080000:0.0:1789302081.363654:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1789302081.363659:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789302081.363670:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1789302081.363675:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.109@tcp (null) (null) 00000040:00080000:0.0:1789302081.363685:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1789302081.363689:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789302081.363700:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789302081.363714:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789302081.363722:0:6523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789302081.363799:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1789302081.363809:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1789302081.363822:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789302081.363840:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789302081.363857:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1789302081.363863:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1789302081.363874:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789302081.363892:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789302081.363897:0:6523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1789302081.363917:0:6523:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789302081.363924:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1789302081.367595:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789302081.368771:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789302081.368800:0:6523:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.109@tcp for mdt 20000000:01000000:2.0:1789302081.368802:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.109@tcp (null) (null) (null) 00000040:00080000:2.0:1789302081.368818:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789302081.368824:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789302081.368837:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789302081.368842:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.109@tcp (null) (null) 00000040:00080000:2.0:1789302081.368858:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789302081.368866:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1789302081.368883:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1789302081.368900:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1789302081.368958:0:6523:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1789302081.368967:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1789302081.370973:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1789302081.377846:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789302081.377886:0:6523:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.109@tcp for mdt 20000000:01000000:3.0:1789302081.377888:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.109@tcp (null) (null) (null) 00000040:00080000:3.0:1789302081.377907:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789302081.377914:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789302081.377928:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789302081.377934:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.109@tcp (null) (null) 00000040:00080000:3.0:1789302081.377948:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789302081.377955:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1789302081.377968:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789302081.377983:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1789302081.378008:0:6523:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789302081.378012:0:6523:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789302081.378016:0:6523:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789302081.378064:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789302081.378067:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789302081.378682:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789302081.378707:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789302081.378733:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789302081.378911:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789302081.378933:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789302081.378950:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789302081.378961:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789302081.378963:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789302081.379350:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789302081.379369:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789302081.379384:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789302081.379569:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1789302081.379589:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1789302081.379605:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1789302081.379615:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789302081.379631:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789302081.380159:0:7470:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789302081.380178:0:7470:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789302081.380195:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789302081.380497:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789302081.380519:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789302081.380542:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789302081.380557:0:6523:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789302081.380560:0:6523:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789302081.380564:0:6523:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789302081.380570:0:6523:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789302081.380856:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1789302081.380950:0:6523:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789302081.403801:0:6523:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789302081.403841:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.403875:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000000b79707/0x1ff82925bd398e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398e07 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.403881:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000379f50e7/0x1ff82925bd398e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398e23 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.403886:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001a5fd806/0x1ff82925bd398e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398e93 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.403891:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.403928:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001a5fd806/0x1ff82925bd398e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398e93 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.403942:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001a5fd806/0x1ff82925bd398e9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398e93 expref: 12 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.403955:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a2043f4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121373440:0@lo:104: 00000100:00100000:1.0:1789302081.404015:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302081.404076:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000379f50e7/0x1ff82925bd398e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398e23 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.404084:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000379f50e7/0x1ff82925bd398e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398e23 expref: 12 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.404091:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000825fc10f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121373568:0@lo:104: 00000100:00100000:2.0:1789302081.404207:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121373440 00000100:00100000:2.0:1789302081.404216:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121373440 00000100:00100000:2.0:1789302081.404268:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302081.404286:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000efec9bf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:6523:x1876219121373440:12345-0@lo:104: 00010000:00010000:2.0:1789302081.404305:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.404353:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789302081.404358:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000efec9bf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:6523:x1876219121373440:12345-0@lo:104: Request processed in 84us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.404364:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789302081.404384:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302081.404389:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.404395:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009e289b10 already unused, calling callback (0000000091532f94) 10000000:00010000:2.0:1789302081.404398:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.404413:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302081.404419:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302081.404423:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302081.404450:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.404456:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302081.404476:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.404481:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: 000000009e289b10/0x1ff82925bd398e93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.404493:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302081.404495:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302081.404496:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302081.404848:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302081.404876:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fcb40237 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121373696:0@lo:103: 00000100:00100000:1.0:1789302081.404912:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302081.404951:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121373696 00000100:00100000:1.0:1789302081.404955:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121373696 00010000:00010000:1.0:1789302081.404972:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001a5fd806/0x1ff82925bd398e9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398e93 expref: 13 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.404991:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302081.404997:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000da2479fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+13:3648:x1876219121373696:12345-0@lo:103: 00010000:00010000:1.0:1789302081.405006:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302081.405010:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001a5fd806/0x1ff82925bd398e9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398e93 expref: 13 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405019:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001a5fd806/0x1ff82925bd398e9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398e93 expref: 13 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405032:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302081.405059:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000da2479fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+13:3648:x1876219121373696:12345-0@lo:103: Request processed in 63us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.405065:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302081.405095:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fcb40237 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121373696:0@lo:103: 00000100:00100000:1.0:1789302081.405138:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121373568 00000100:00100000:1.0:1789302081.405142:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121373568 00000100:00100000:1.0:1789302081.405161:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302081.405166:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d3bce1c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:6523:x1876219121373568:12345-0@lo:104: 00010000:00010000:1.0:1789302081.405173:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405203:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789302081.405207:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d3bce1c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:6523:x1876219121373568:12345-0@lo:104: Request processed in 42us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.405218:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789302081.405243:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000000b79707/0x1ff82925bd398e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398e07 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405251:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000000b79707/0x1ff82925bd398e0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398e07 expref: 12 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.405260:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b42cd957 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121373824:0@lo:104: 00000100:00100000:1.0:1789302081.405281:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302081.405311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121373824 00000100:00100000:1.0:1789302081.405315:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121373824 00000100:00100000:1.0:1789302081.405333:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302081.405338:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000befb273 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:6523:x1876219121373824:12345-0@lo:104: 00010000:00010000:1.0:1789302081.405344:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405374:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789302081.405377:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000befb273 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:6523:x1876219121373824:12345-0@lo:104: Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.405383:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789302081.405395:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302081.405398:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405404:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000091ee89c4 already unused, calling callback (0000000091532f94) 10000000:00010000:1.0:1789302081.405407:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405413:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302081.405424:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302081.405429:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302081.405446:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405452:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302081.405464:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405468:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398e23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e2a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405479:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302081.405481:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405486:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c4db007c already unused, calling callback (0000000091532f94) 10000000:00010000:1.0:1789302081.405487:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405493:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302081.405498:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302081.405503:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302081.405522:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405528:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302081.405532:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405537:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: 00000000c4db007c/0x1ff82925bd398e07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e0e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405551:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302081.405553:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302081.405554:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302081.405562:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ebbb3f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121373952:0@lo:103: 00000100:00100000:1.0:1789302081.405587:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302081.405606:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302081.405611:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000742fb4ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121374080:0@lo:103: 00000100:00100000:1.0:1789302081.405643:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302081.405667:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121373952 00000100:00100000:1.0:1789302081.405671:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121373952 00010000:00010000:1.0:1789302081.405684:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000379f50e7/0x1ff82925bd398e2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398e23 expref: 13 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.405697:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121374080 00000100:00100000:1.0:1789302081.405700:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121374080 00010000:00010000:1.0:1789302081.405709:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000000b79707/0x1ff82925bd398e0e lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398e07 expref: 14 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.405720:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302081.405725:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d694eb1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+14:3645:x1876219121373952:12345-0@lo:103: 00010000:00010000:1.0:1789302081.405740:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302081.405743:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000379f50e7/0x1ff82925bd398e2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398e23 expref: 14 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405750:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000379f50e7/0x1ff82925bd398e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398e23 expref: 14 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405759:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302081.405786:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d694eb1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+14:3645:x1876219121373952:12345-0@lo:103: Request processed in 61us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.405791:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302081.405805:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302081.405810:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000017534731 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+13:3645:x1876219121374080:12345-0@lo:103: 00010000:00010000:1.0:1789302081.405818:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302081.405821:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000000b79707/0x1ff82925bd398e0e lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398e07 expref: 13 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405829:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000000b79707/0x1ff82925bd398e0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398e07 expref: 13 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405839:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405846:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405859:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405865:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405876:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405882:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405887:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ba2ec9a1 already unused, calling callback (000000006b2f69eb) 00010000:00010000:1.0:1789302081.405889:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405895:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405902:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.405911:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302081.405933:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000017534731 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+13:3645:x1876219121374080:12345-0@lo:103: Request processed in 123us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.405939:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302081.405965:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000742fb4ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121374080:0@lo:103: 00000100:00100000:1.0:1789302081.405973:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ebbb3f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121373952:0@lo:103: 00000100:00100000:1.0:1789302081.405995:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set 0000000090d34b5a going to sleep for 11 seconds 00010000:00010000:1.0:1789302081.406006:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001a5fd806/0x1ff82925bd398e9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398e93 expref: 12 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.406014:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a2043f4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121373440:0@lo:104: 00010000:00010000:1.0:1789302081.406020:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000379f50e7/0x1ff82925bd398e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398e23 expref: 11 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.406035:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000825fc10f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121373568:0@lo:104: 00010000:00010000:1.0:1789302081.406044:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000000b79707/0x1ff82925bd398e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398e07 expref: 10 pid: 6524 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.406051:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b42cd957 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121373824:0@lo:104: 00010000:00010000:1.0:1789302081.406063:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.406071:0:6523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.406077:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.406081:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ba2ec9a1/0x1ff82925bd398ed9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789302081.406095:0:6523:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:3.0:1789302081.406459:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302081.409847:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001153ae90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+9:7460:x1876219121373312:12345-0@lo:253: Request processed in 47059us (47757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.409862:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789302081.409956:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040b46c72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121373312:0@lo:253: 10000000:01000000:2.0:1789302081.409972:0:7460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789302081.409974:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789302081.409976:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789302081.409978:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302081.409979:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789302081.409980:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302081.409981:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302081.409982:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302081.409983:0:7460:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789302081.409985:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302081.409995:0:7460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789302081.410012:0:7460:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a06091f1 from lustre-MDT0001 10000000:01000000:2.0:1789302081.410042:0:7460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789302081.410045:0:7460:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789302081.410052:0:7460:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cc4ac2ab380 local copy 10000000:01000000:2.0:1789302081.410056:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789302081.410086:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.410096:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.410104:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302081.410150:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040b46c72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374208:0@lo:101: 00000100:00100000:2.0:1789302081.410183:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302081.410212:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e778f0a going to sleep for 11 seconds 00000100:00100000:1.0:1789302081.410268:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121374208 00000100:00100000:1.0:1789302081.410274:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121374208 00000100:00100000:1.0:1789302081.410335:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789302081.410344:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d36ab82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+9:7460:x1876219121374208:12345-0@lo:101: 00010000:00010000:1.0:1789302081.410355:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302081.410368:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049f66373/0x1ff82925bd398ee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398ee0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.410399:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049f66373/0x1ff82925bd398ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398ee0 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.410407:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049f66373/0x1ff82925bd398ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398ee0 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.410414:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049f66373, rc 0) 00000100:00100000:1.0:1789302081.410446:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d36ab82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+10:7460:x1876219121374208:12345-0@lo:101: Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.410451:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789302081.410997:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040b46c72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374208:0@lo:101: 00010000:00010000:0.0:1789302081.411012:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.411020:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302081.411108:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5d06137 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374336:0@lo:501: 00000100:00100000:0.0:1789302081.411168:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302081.411190:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ec5acbc going to sleep for 11 seconds 00000100:00100000:1.0:1789302081.411265:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121374336 00000100:00100000:1.0:1789302081.411269:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121374336 00000100:00100000:1.0:1789302081.411307:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789302081.411314:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fb2527 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+10:7460:x1876219121374336:12345-0@lo:501: 00000100:00100000:1.0:1789302081.411492:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fb2527 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+10:7460:x1876219121374336:12345-0@lo:501: Request processed in 179us (323us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302081.411500:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789302081.411777:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5d06137 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374336:0@lo:501: 10000000:01000000:2.0:1789302081.411791:0:7460:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789302081.411812:0:7460:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789302081.411817:0:7460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.411825:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.411831:0:7460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.411898:0:7460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789302081.411922:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cc4b511e800 10000000:01000000:2.0:1789302081.411926:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789302081.411930:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cc4ac2ab380 10000000:01000000:2.0:1789302081.411932:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789302081.411935:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cc4ac2ab380 from 1 10000000:01000000:2.0:1789302081.411937:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789302081.411956:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 0000000079de7df0/0x1ff82925bd398eee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.411964:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 0000000079de7df0/0x1ff82925bd398eee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.411971:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 0000000079de7df0/0x1ff82925bd398eee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302081.411983:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084f68abe pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374464:0@lo:101: 00000100:00100000:2.0:1789302081.412011:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302081.412036:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e9f5681 going to sleep for 11 seconds 00000100:00100000:3.0:1789302081.412234:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121374464 00000100:00100000:3.0:1789302081.412239:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121374464 00000100:00100000:3.0:1789302081.412268:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789302081.412275:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000031f7027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+10:7460:x1876219121374464:12345-0@lo:101: 00010000:00010000:3.0:1789302081.412283:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302081.412295:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000106bf6d9/0x1ff82925bd398ef5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398eee expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.412561:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000106bf6d9/0x1ff82925bd398ef5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398eee expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.412571:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000106bf6d9/0x1ff82925bd398ef5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398eee expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.412577:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000106bf6d9, rc 0) 00000100:00100000:2.0:1789302081.412630:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000031f7027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+11:7460:x1876219121374464:12345-0@lo:101: Request processed in 344us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.412636:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789302081.412968:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084f68abe pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374464:0@lo:101: 00010000:00010000:3.0:1789302081.412980:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 0000000079de7df0/0x1ff82925bd398eee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398ef5 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.412988:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 0000000079de7df0/0x1ff82925bd398eee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398ef5 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302081.413017:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789302081.413025:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 0000000079de7df0/0x1ff82925bd398eee lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398ef5 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.413031:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 0000000079de7df0/0x1ff82925bd398eee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398ef5 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302081.413040:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cc4b511e800 10000000:01000000:3.0:1789302081.413044:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789302081.413047:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cc4b511e800 from 1 10000000:01000000:3.0:1789302081.413049:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789302081.413066:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 00000000cd34b402/0x1ff82925bd398efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.413072:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 00000000cd34b402/0x1ff82925bd398efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.413079:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 00000000cd34b402/0x1ff82925bd398efc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302081.413091:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374592:0@lo:101: 00000100:00100000:3.0:1789302081.413150:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302081.413175:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baaf364b going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.413232:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121374592 00000100:00100000:0.0:1789302081.413237:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121374592 00000100:00100000:0.0:1789302081.413277:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789302081.413288:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cabaa788 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+11:7460:x1876219121374592:12345-0@lo:101: 00010000:00010000:0.0:1789302081.413296:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302081.413312:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc72d878/0x1ff82925bd398f03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398efc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.413326:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc72d878/0x1ff82925bd398f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398efc expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.413334:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc72d878/0x1ff82925bd398f03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398efc expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.413340:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc72d878, rc 0) 00000100:00100000:0.0:1789302081.413375:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cabaa788 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:7460:x1876219121374592:12345-0@lo:101: Request processed in 89us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302081.413388:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789302081.413510:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374592:0@lo:101: 00010000:00010000:3.0:1789302081.413523:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 00000000cd34b402/0x1ff82925bd398efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.413529:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 00000000cd34b402/0x1ff82925bd398efc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302081.413546:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789302081.413549:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 00000000cd34b402/0x1ff82925bd398efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.413558:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 00000000cd34b402/0x1ff82925bd398efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302081.413567:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789302081.413569:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789302081.413573:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cc4b511e800 10000000:01000000:3.0:1789302081.413578:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789302081.413581:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789302081.413583:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789302081.413594:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 000000003b53a2b9/0x1ff82925bd398f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.413601:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 000000003b53a2b9/0x1ff82925bd398f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.413611:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 000000003b53a2b9/0x1ff82925bd398f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302081.413632:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374720:0@lo:101: 00000100:00100000:3.0:1789302081.413656:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302081.413680:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baaf364b going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.413822:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121374720 00000100:00100000:0.0:1789302081.413827:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121374720 00000100:00100000:0.0:1789302081.413863:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789302081.413870:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a4672513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+12:7460:x1876219121374720:12345-0@lo:101: 00010000:00010000:0.0:1789302081.413877:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302081.413884:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e289b10/0x1ff82925bd398f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398f0a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.413901:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e289b10/0x1ff82925bd398f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398f0a expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.413908:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e289b10/0x1ff82925bd398f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398f0a expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.413913:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e289b10, rc 0) 00000100:00100000:0.0:1789302081.413947:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a4672513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+13:7460:x1876219121374720:12345-0@lo:101: Request processed in 78us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302081.413953:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789302081.414013:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374720:0@lo:101: 00010000:00010000:3.0:1789302081.414023:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 000000003b53a2b9/0x1ff82925bd398f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.414041:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 000000003b53a2b9/0x1ff82925bd398f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302081.414152:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374848:0@lo:501: 00000100:00100000:3.0:1789302081.414179:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302081.414197:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baaf364b going to sleep for 11 seconds 00000100:00100000:2.0:1789302081.414244:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121374848 00000100:00100000:2.0:1789302081.414249:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121374848 00000100:00100000:2.0:1789302081.414282:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302081.414291:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000379a1076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+13:7460:x1876219121374848:12345-0@lo:501: 00000100:00100000:2.0:1789302081.414401:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000379a1076 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+13:7460:x1876219121374848:12345-0@lo:501: Request processed in 113us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.414408:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302081.414537:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374848:0@lo:501: 00000100:00100000:3.0:1789302081.414563:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374976:0@lo:503: 00000100:00100000:3.0:1789302081.414607:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302081.414637:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 00000000baaf364b going to sleep for 11 seconds 00010000:00010000:1.0:1789302081.414717:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302081.414722:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.414730:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b6d1ed9 already unused, calling callback (0000000091532f94) 10000000:00010000:1.0:1789302081.414733:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.414740:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302081.414763:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302081.414769:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302081.414789:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.414795:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302081.414822:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.414829:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: 000000003b6d1ed9/0x1ff82925bd398ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1ff82925bd398ee7 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.414839:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302081.414841:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302081.414842:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302081.414850:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302081.414862:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b42cd957 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121375104:0@lo:103: 00000100:00100000:1.0:1789302081.414895:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302081.414920:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121375104 00000100:00100000:1.0:1789302081.414924:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121375104 00000100:00100000:1.0:1789302081.414951:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302081.414957:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000825fc10f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+13:3648:x1876219121375104:12345-0@lo:103: 00010000:00010000:1.0:1789302081.414965:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302081.414979:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000049f66373/0x1ff82925bd398ee7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd398ee0 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.414991:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302081.415026:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000825fc10f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+12:3648:x1876219121375104:12345-0@lo:103: Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.415032:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302081.415064:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b42cd957 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121375104:0@lo:103: 00000100:00100000:2.0:1789302081.415148:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121374976 00000100:00100000:2.0:1789302081.415152:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121374976 00000100:00100000:2.0:1789302081.415175:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789302081.415181:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000e225dfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:7460:x1876219121374976:12345-0@lo:503: 00000100:00100000:2.0:1789302081.415260:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000e225dfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:7460:x1876219121374976:12345-0@lo:503: Request processed in 80us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.415267:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789302081.415523:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121374976:0@lo:503: 00000040:00080000:1.0:1789302081.415788:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789302081.415858:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b42cd957 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121375232:0@lo:502: 00000100:00100000:1.0:1789302081.415897:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302081.415922:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021975d40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302081.415976:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121375232 00000100:00100000:2.0:1789302081.415980:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121375232 00000100:00100000:2.0:1789302081.416011:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302081.416016:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000094db9537 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:7460:x1876219121375232:12345-0@lo:502: 00000100:00100000:2.0:1789302081.416103:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000094db9537 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:7460:x1876219121375232:12345-0@lo:502: Request processed in 86us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.416228:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b42cd957 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121375232:0@lo:502: 00000040:00080000:1.0:1789302081.416477:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789302081.416509:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1789302081.416526:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1789302081.416538:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1789302081.416550:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1789302081.416568:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1789302081.416585:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1789302081.416599:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1789302081.416615:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1789302081.416638:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1789302081.416651:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1789302081.416668:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1789302081.416682:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1789302081.416696:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1789302081.416710:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1789302081.416727:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1789302081.416740:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1789302081.416756:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1789302081.416773:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1789302081.416796:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1789302081.416813:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1789302081.416830:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000100:00100000:2.0:1789302081.416883:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000040:00080000:1.0:1789302081.416996:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1789302081.417025:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b42cd957 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121375360:0@lo:502: 00000100:00100000:1.0:1789302081.417069:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302081.417264:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021975d40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.417921:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121375360 00000100:00100000:0.0:1789302081.417929:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121375360 00000100:00100000:0.0:1789302081.418006:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789302081.418013:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001079ef85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+12:7460:x1876219121375360:12345-0@lo:502: 00000100:00100000:0.0:1789302081.418140:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001079ef85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+12:7460:x1876219121375360:12345-0@lo:502: Request processed in 127us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302081.418148:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789302081.418235:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b42cd957 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121375360:0@lo:502: 00000040:00080000:1.0:1789302081.418288:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1789302081.418297:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1789302081.419292:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302081.419314:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302081.419317:0:7472:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789302081.419321:0:7472:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789302081.419325:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789302081.419337:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000d2f69e87) 00000020:00000080:1.0:1789302081.419357:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1789302081.419363:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789302081.419445:0:7472:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789302081.419453:0:7472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd398f1f 00000020:00000080:1.0:1789302081.419940:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789302081.419946:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302081.419950:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302081.419951:0:7472:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789302081.419954:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302081.419959:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302081.419960:0:7472:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789302081.419963:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789302081.419970:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000005eb44b81) 00000020:00000080:1.0:1789302081.419981:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1789302081.419985:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789302081.419992:0:7472:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789302081.419995:0:7472:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789302081.420001:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789302081.420048:0:7472:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a06091f1 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789302081.420060:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000de1a846f) 00000020:00000080:1.0:1789302081.420069:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1789302081.420454:0:7472:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789302081.420462:0:7472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd398f34 00000020:00000080:1.0:1789302081.420553:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789302081.420560:0:7472:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789302081.420564:0:7472:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x1ff82925bd398f3b 00080000:01000000:1.0:1789302081.420570:0:7472:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789302081.420573:0:7472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd398f42 00080000:10000000:1.0:1789302081.420922:0:7472:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789302081.421578:0:7472:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1789302081.548677:0:7472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789302081.548922:0:7472:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789302081.551823:0:7472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789302081.552208:0:7472:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789302081.567184:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789302081.567199:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302081.567206:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302081.567208:0:7472:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789302081.567213:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302081.567219:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302081.567220:0:7472:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789302081.567224:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789302081.567229:0:7472:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:00000080:3.0:1789302081.567257:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302081.567284:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000005b7e55c6) 00000020:00000080:3.0:1789302081.567317:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789302081.567324:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789302081.567390:0:7472:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789302081.567397:0:7472:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789302081.567404:0:7472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd398f50 00010000:00080000:3.0:1789302081.567433:0:7472:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000027c5dffe@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.109@tcp at head 00010000:00010000:3.0:1789302081.574679:0:7472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1789302081.581564:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789302081.581580:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789302081.581638:0:7472:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789302081.581660:0:7472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd398f57 00000100:00080000:3.0:1789302081.581671:0:7472:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302081.581683:0:7472:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000027c5dffe using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302081.581717:0:7472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f12c61ba x1876219121375488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302081.581782:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f12c61ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121375488:0@lo:38: 00000100:00100000:1.0:1789302081.581849:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789302081.581925:0:7472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789302081.581990:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085eb0071 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121375616:0@lo:400: 00000100:00100000:3.0:1789302081.582020:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302081.582060:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121375616 00000100:00100000:3.0:1789302081.582067:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121375616 00000100:00100000:3.0:1789302081.582104:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302081.582137:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be33ea8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121375616:12345-0@lo:400: 00000100:00100000:3.0:1789302081.582185:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be33ea8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121375616:12345-0@lo:400: Request processed in 74us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302081.582192:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789302081.582225:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000085eb0071 x1876219121375616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302081.582237:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085eb0071 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121375616:0@lo:400: 00000020:01000000:3.0:1789302081.582297:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302081.582310:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302081.582312:0:7472:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789302081.582315:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789302081.582318:0:7472:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789302081.582319:0:7472:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302081.582321:0:7472:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302081.582329:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789302081.582332:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302081.582333:0:7472:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789302081.582336:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302081.582341:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302081.582342:0:7472:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789302081.582346:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789302081.582379:0:7472:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789302081.582394:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302081.582397:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302081.582398:0:7472:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789302081.582401:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302081.582403:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302081.582404:0:7472:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789302081.582407:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789302081.582408:0:7472:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789302081.582435:0:7472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302081.582438:0:7472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302081.582440:0:7472:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789302081.582443:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1789302081.582493:0:7460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1789302081.582519:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789302081.582533:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 000000003b53a2b9/0x1ff82925bd398f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.582543:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 000000003b53a2b9/0x1ff82925bd398f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302081.582551:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b511e800 from 1 10000000:01000000:3.0:1789302081.582554:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789302081.582577:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.582594:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.582604:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302081.582627:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085eb0071 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121375744:0@lo:101: 00000100:00100000:3.0:1789302081.582659:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302081.582681:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fddbe7a going to sleep for 11 seconds 00000100:00100000:2.0:1789302081.583225:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121375488 00000100:00100000:2.0:1789302081.583232:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121375488 00000100:00100000:2.0:1789302081.583406:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302081.583412:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b42cd957 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876219121375488:12345-0@lo:38: 00010000:00080000:2.0:1789302081.583432:0:6535:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:2.0:1789302081.583464:0:6535:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd398f65 00000004:00100000:2.0:1789302081.583478:0:6535:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789302081.583483:0:6535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789302081.583551:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121375744 00000100:00100000:2.0:1789302081.583556:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121375744 00000100:00100000:2.0:1789302081.583600:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789302081.583607:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9f619f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+12:7460:x1876219121375744:12345-0@lo:101: 00010000:00010000:2.0:1789302081.583635:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302081.583649:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a6981af/0x1ff82925bd398f6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398f5e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.583668:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a6981af/0x1ff82925bd398f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398f5e expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.583679:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a6981af/0x1ff82925bd398f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398f5e expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.583687:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a6981af, rc 0) 00000100:00100000:2.0:1789302081.583725:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9f619f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+13:7460:x1876219121375744:12345-0@lo:101: Request processed in 119us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.583732:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789302081.586054:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085eb0071 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121375744:0@lo:101: 00010000:00010000:3.0:1789302081.586081:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.586092:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302081.586726:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085eb0071 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121375872:0@lo:256: 00000100:00100000:3.0:1789302081.586787:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302081.586826:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fddbe7a going to sleep for 11 seconds 00000100:00100000:2.0:1789302081.588534:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121375872 00000100:00100000:2.0:1789302081.588547:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121375872 00000100:00100000:2.0:1789302081.588590:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789302081.588598:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac814e41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+13:7460:x1876219121375872:12345-0@lo:256: 20000000:01000000:2.0:1789302081.588648:0:6524:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789302081.588663:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789302081.588666:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789302081.588773:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac814e41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+13:7460:x1876219121375872:12345-0@lo:256: Request processed in 175us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.588781:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789302081.590537:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085eb0071 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121375872:0@lo:256: 00000100:00080000:2.0:1789302081.592214:0:6535:0:(import.c:65:import_set_state_nolock()) 00000000046a317b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302081.592466:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b42cd957 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876219121375488:12345-0@lo:38: Request processed in 9050us (10615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.592476:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 10000000:01000000:3.0:1789302081.592850:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789302081.592875:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.592887:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302081.592914:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b511e800 from 1 10000000:01000000:3.0:1789302081.592917:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789302081.592945:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.592951:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.592958:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302081.592975:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085eb0071 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376000:0@lo:101: 00000100:00100000:3.0:1789302081.593016:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302081.593052:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fddbe7a going to sleep for 11 seconds 00000100:00100000:3.0:1789302081.593074:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121376000 00000100:00100000:3.0:1789302081.593080:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121376000 00000100:00100000:3.0:1789302081.593136:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789302081.593144:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d45cafeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+13:7460:x1876219121376000:12345-0@lo:101: 00010000:00010000:3.0:1789302081.593152:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302081.593164:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000562b7be4/0x1ff82925bd398f7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398f73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.593184:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000562b7be4/0x1ff82925bd398f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398f73 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.593194:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000562b7be4/0x1ff82925bd398f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398f73 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.593202:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000562b7be4, rc 0) 00000100:00100000:3.0:1789302081.593238:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d45cafeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+14:7460:x1876219121376000:12345-0@lo:101: Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302081.593244:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789302081.593614:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085eb0071 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376000:0@lo:101: 00010000:00010000:3.0:1789302081.593647:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302081.593655:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302081.593741:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085eb0071 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376128:0@lo:501: 00000100:00100000:3.0:1789302081.593769:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302081.593798:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fddbe7a going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.594036:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121376128 00000100:00100000:0.0:1789302081.594042:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121376128 00000100:00100000:0.0:1789302081.594079:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789302081.594085:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e024dee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+14:7460:x1876219121376128:12345-0@lo:501: 00000100:00100000:0.0:1789302081.594196:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e024dee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+14:7460:x1876219121376128:12345-0@lo:501: Request processed in 111us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302081.594203:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789302081.594241:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085eb0071 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376128:0@lo:501: 00000100:00100000:0.0:1789302081.594281:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067f7139e pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376256:0@lo:503: 00000100:00100000:0.0:1789302081.594330:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302081.594343:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036aca297 going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.594357:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121376256 00000100:00100000:0.0:1789302081.594361:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121376256 00000100:00100000:0.0:1789302081.594382:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789302081.594388:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae15006f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+14:7460:x1876219121376256:12345-0@lo:503: 00000040:00080000:0.0:1789302081.594420:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789302081.594455:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae15006f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+14:7460:x1876219121376256:12345-0@lo:503: Request processed in 67us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302081.594462:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789302081.594500:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067f7139e pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376256:0@lo:503: 00000040:00080000:0.0:1789302081.594743:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302081.594785:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1789302081.594849:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302081.595731:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1789302081.595774:0:7460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789302081.595797:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302081.595808:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.595830:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302081.595874:0:7460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789302081.595877:0:7460:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cc4b511e800 10000000:01000000:0.0:1789302081.595879:0:7460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cc4b511e800 10000000:01000000:0.0:1789302081.595883:0:7460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789302081.595887:0:7460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4b511e800 from 1 10000000:01000000:0.0:1789302081.595889:0:7460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789302081.596050:0:7460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 0000000016fdabff/0x1ff82925bd398f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.596058:0:7460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 0000000016fdabff/0x1ff82925bd398f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.596067:0:7460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 0000000016fdabff/0x1ff82925bd398f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302081.596084:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067f7139e pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376384:0@lo:101: 00000100:00100000:0.0:1789302081.596147:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302081.596167:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036aca297 going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.596194:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121376384 00000100:00100000:0.0:1789302081.596200:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121376384 00000100:00100000:0.0:1789302081.596231:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789302081.596238:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea3edbf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+14:7460:x1876219121376384:12345-0@lo:101: 00010000:00010000:0.0:1789302081.596248:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302081.598001:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4db007c/0x1ff82925bd398f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398f81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.598048:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4db007c/0x1ff82925bd398f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398f81 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.598059:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4db007c/0x1ff82925bd398f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398f81 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.598066:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4db007c, rc 0) 00000100:00100000:0.0:1789302081.598147:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea3edbf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:7460:x1876219121376384:12345-0@lo:101: Request processed in 1909us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302081.598155:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789302081.598227:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067f7139e pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376384:0@lo:101: 00010000:00010000:0.0:1789302081.598243:0:7460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 0000000016fdabff/0x1ff82925bd398f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302081.598252:0:7460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 0000000016fdabff/0x1ff82925bd398f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302081.598561:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067f7139e pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376512:0@lo:501: 00000100:00100000:0.0:1789302081.598591:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302081.598635:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036aca297 going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.598654:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121376512 00000100:00100000:0.0:1789302081.598660:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121376512 00000100:00100000:0.0:1789302081.598690:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789302081.598697:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e87df1b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:7460:x1876219121376512:12345-0@lo:501: 00000100:00100000:0.0:1789302081.598792:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e87df1b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:7460:x1876219121376512:12345-0@lo:501: Request processed in 96us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302081.598798:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789302081.598839:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067f7139e pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376512:0@lo:501: 00000100:00100000:0.0:1789302081.598864:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067f7139e pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376640:0@lo:503: 00000100:00100000:0.0:1789302081.598974:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302081.598988:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f9bbd94 going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.599001:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121376640 00000100:00100000:0.0:1789302081.599004:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121376640 00000100:00100000:0.0:1789302081.599024:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789302081.599031:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002afbb6b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:7460:x1876219121376640:12345-0@lo:503: 00000100:00100000:0.0:1789302081.599102:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002afbb6b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:7460:x1876219121376640:12345-0@lo:503: Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302081.599109:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789302081.599177:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067f7139e pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376640:0@lo:503: 00000100:00100000:1.0:1789302081.599450:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789302081.599458:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789302081.599466:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789302081.599471:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789302081.599474:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000027c5dffe lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789302081.599494:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f12c61ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121375488:0@lo:38: 00000100:00100000:3.0:1789302081.599595:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302081.599603:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002168c418 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121376768:0@lo:41: 00000100:00100000:3.0:1789302081.599647:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302081.599688:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121376768 00000100:00100000:3.0:1789302081.599692:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121376768 00000100:00100000:3.0:1789302081.599715:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302081.599721:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007885781b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876219121376768:12345-0@lo:41: 00000004:00000024:3.0:1789302081.599742:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789302081.599778:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007885781b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876219121376768:12345-0@lo:41: Request processed in 57us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302081.599784:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302081.599811:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002168c418 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121376768:0@lo:41: 00000040:00080000:0.0:1789302081.600975:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789302081.601043:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067f7139e pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376896:0@lo:502: 00000100:00100000:0.0:1789302081.601088:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302081.601293:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f9bbd94 going to sleep for 11 seconds 00000100:00100000:2.0:1789302081.601453:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121376896 00000100:00100000:2.0:1789302081.601459:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121376896 00000100:00100000:2.0:1789302081.601534:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789302081.601542:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f3bd80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:7460:x1876219121376896:12345-0@lo:502: 00000100:00100000:2.0:1789302081.601651:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f3bd80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:7460:x1876219121376896:12345-0@lo:502: Request processed in 110us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.601658:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789302081.601735:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067f7139e pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121376896:0@lo:502: 00000040:00080000:1.0:1789302081.601932:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789302081.601958:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789302081.601973:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789302081.601988:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789302081.602001:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789302081.602014:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789302081.602028:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789302081.602053:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789302081.602083:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789302081.602097:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789302081.602141:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789302081.602160:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789302081.602176:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789302081.602190:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789302081.602203:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789302081.602230:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789302081.602246:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789302081.602259:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789302081.602288:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789302081.602313:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789302081.602328:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789302081.602341:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789302081.602355:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789302081.602367:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789302081.602380:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789302081.602393:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789302081.602406:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789302081.602418:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789302081.602441:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a2043f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121377024:0@lo:502: 00000100:00100000:1.0:1789302081.602480:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302081.604041:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d3e1ffa going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.604080:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121377024 00000100:00100000:0.0:1789302081.604089:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121377024 00000100:00100000:0.0:1789302081.604289:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789302081.604298:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c637a2ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:7460:x1876219121377024:12345-0@lo:502: 00000100:00100000:0.0:1789302081.604570:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c637a2ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:7460:x1876219121377024:12345-0@lo:502: Request processed in 273us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302081.604578:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789302081.604732:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a2043f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121377024:0@lo:502: 00000040:00080000:0.0:1789302081.604803:0:7460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789302081.604815:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789302081.605696:0:7478:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789302081.605711:0:7478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000007cde7fc0) 00000020:00000080:2.0:1789302081.605731:0:7478:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789302081.605828:0:7478:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a06091f1 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789302081.605832:0:7478:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a06091f1 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789302081.605834:0:7478:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a06091f1 3 00010000:00080000:2.0:1789302081.605874:0:7478:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000091a7790b@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.109@tcp at head 00010000:00010000:2.0:1789302081.608830:0:7478:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1789302081.609209:0:7478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789302081.609250:0:7478:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789302081.609273:0:7478:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x1ff82925bd398f96 00000100:00080000:2.0:1789302081.609393:0:7478:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789302081.609406:0:7478:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000091a7790b using connection 192.168.203.109@tcp/0@lo 00000100:00100000:2.0:1789302081.609441:0:7478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000018842b4e x1876219121377152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302081.609489:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018842b4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876219121377152:0@lo:38: 00000100:00100000:1.0:1789302081.609555:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302081.609653:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121377152 00000100:00100000:3.0:1789302081.609661:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121377152 00000100:00100000:3.0:1789302081.609704:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302081.609709:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002ebbb3f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876219121377152:12345-0@lo:38: 00010000:00080000:3.0:1789302081.609729:0:6531:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:3.0:1789302081.609759:0:6531:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1ff82925bd398f9d 00000004:00100000:3.0:1789302081.609773:0:6531:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789302081.609799:0:6531:0:(import.c:65:import_set_state_nolock()) 00000000bd7eae99 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789302081.609850:0:7478:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789302081.613225:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002ebbb3f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876219121377152:12345-0@lo:38: Request processed in 3506us (3662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302081.613239:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1789302081.614213:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1789302081.614525:0:7480:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00010000:00080000:1.0:1789302081.615732:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000018842b4e x1876219121377152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302081.615747:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789302081.615757:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789302081.615778:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789302081.615783:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789302081.615786:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000091a7790b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789302081.615794:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018842b4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876219121377152:0@lo:38: 00000020:01000000:2.0:1789302081.620541:0:7460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789302081.620590:0:7460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302081.620611:0:7460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 0000000016fdabff/0x1ff82925bd398f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.620636:0:7460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 0000000016fdabff/0x1ff82925bd398f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789302081.620706:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789302081.620709:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789302081.620710:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302081.620711:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302081.620712:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302081.620714:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302081.620715:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302081.620716:0:7460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302081.620718:0:7460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302081.620719:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302081.620720:0:7460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302081.620723:0:7460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1789302081.620726:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302081.620727:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789302081.620728:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302081.620729:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302081.620731:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302081.620732:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302081.620732:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302081.620733:0:7460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302081.620740:0:7460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302081.620741:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302081.620742:0:7460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302081.620769:0:7460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789302081.620788:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f2fd232 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121377280:0@lo:253: 00000100:00100000:2.0:1789302081.620860:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302081.622047:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d81d410 going to sleep for 11 seconds 00000100:00100000:2.0:1789302081.628635:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121377280 00000100:00100000:2.0:1789302081.628651:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121377280 00000100:00100000:3.0:1789302081.634584:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789302081.634598:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000aa73b3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:7460:x1876219121377280:12345-0@lo:253: 20000000:01000000:3.0:1789302081.634641:0:6523:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789302081.634654:0:6523:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789302081.637646:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789302081.637783:0:6523:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789302081.637790:0:6523:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789302081.637963:0:6546:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789302081.637968:0:6546:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789302081.637985:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.638002:0:6546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d5b19476/0x1ff82925bd398ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398ebd expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.638009:0:6546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007a6981af/0x1ff82925bd398f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398f5e expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.638015:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.638045:0:6546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007a6981af/0x1ff82925bd398f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398f5e expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.638058:0:6546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007a6981af/0x1ff82925bd398f6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398f5e expref: 15 pid: 6523 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.638069:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000742fb4ed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121377408:0@lo:104: 00000100:00100000:1.0:1789302081.638155:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302081.638195:0:6546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d5b19476/0x1ff82925bd398ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398ebd expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.638202:0:6546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d5b19476/0x1ff82925bd398ec4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398ebd expref: 15 pid: 6523 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.638217:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c12765b0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121377536:0@lo:104: 00000100:00100000:1.0:1789302081.638247:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302081.638412:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121377408 00000100:00100000:2.0:1789302081.638419:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121377408 00000100:00100000:2.0:1789302081.638446:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121377536 00000100:00100000:2.0:1789302081.638448:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121377536 00000100:00100000:2.0:1789302081.638459:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302081.638465:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000000b5eb53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+4:6546:x1876219121377408:12345-0@lo:104: 00010000:00010000:2.0:1789302081.638475:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638515:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789302081.638519:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000000b5eb53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+4:6546:x1876219121377408:12345-0@lo:104: Request processed in 55us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.638525:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302081.638538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302081.638543:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a25065d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:6546:x1876219121377536:12345-0@lo:104: 00010000:00010000:2.0:1789302081.638548:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638571:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789302081.638575:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a25065d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:6546:x1876219121377536:12345-0@lo:104: Request processed in 33us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.638585:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789302081.638598:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302081.638602:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638609:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007703875f already unused, calling callback (0000000091532f94) 10000000:00010000:2.0:1789302081.638612:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638630:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302081.638635:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302081.638640:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302081.638665:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638671:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302081.638684:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638690:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: 000000007703875f/0x1ff82925bd398f5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f6c expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638701:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302081.638703:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638717:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000012bc8936 already unused, calling callback (0000000091532f94) 10000000:00010000:2.0:1789302081.638720:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638725:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302081.638729:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302081.638734:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302081.638743:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638749:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302081.638757:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638762:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: 0000000012bc8936/0x1ff82925bd398ebd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398ec4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302081.638773:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302081.638775:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302081.638776:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302081.638788:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302081.638797:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062f059cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121377664:0@lo:103: 00000100:00100000:2.0:1789302081.638821:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302081.638958:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2f8569c going to sleep for 11 seconds 00000100:00100000:1.0:1789302081.638977:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000742fb4ed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121377408:0@lo:104: 00000100:00100000:1.0:1789302081.638984:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c12765b0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121377536:0@lo:104: 00010000:00010000:1.0:1789302081.639000:0:6546:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302081.640468:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302081.640485:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000657fd2d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121377792:0@lo:103: 00000100:00100000:0.0:1789302081.640536:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302081.640577:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302081.640652:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121377664 00000100:00100000:1.0:1789302081.640659:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121377664 00010000:00010000:1.0:1789302081.640684:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007a6981af/0x1ff82925bd398f6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398f5e expref: 16 pid: 6523 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.640717:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121377792 00000100:00100000:1.0:1789302081.640720:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121377792 00010000:00010000:1.0:1789302081.640730:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d5b19476/0x1ff82925bd398ec4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398ebd expref: 17 pid: 6523 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302081.640743:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789302081.640750:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d688560 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+17:3645:x1876219121377664:12345-0@lo:103: 00010000:00010000:1.0:1789302081.640761:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302081.640765:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007a6981af/0x1ff82925bd398f6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398f5e expref: 17 pid: 6523 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.640774:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007a6981af/0x1ff82925bd398f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398f5e expref: 17 pid: 6523 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.640786:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007a6981af/0x1ff82925bd398f6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398f5e expref: 17 pid: 6523 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.640809:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302081.640845:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d688560 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+16:3645:x1876219121377664:12345-0@lo:103: Request processed in 97us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.640852:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789302081.640867:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789302081.640873:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ab1b80a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+15:3648:x1876219121377792:12345-0@lo:103: 00010000:00010000:1.0:1789302081.640880:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302081.640883:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d5b19476/0x1ff82925bd398ec4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398ebd expref: 15 pid: 6523 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.640959:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d5b19476/0x1ff82925bd398ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398ebd expref: 15 pid: 6523 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.640970:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d5b19476/0x1ff82925bd398ec4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398ebd expref: 15 pid: 6523 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.640979:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.640987:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789302081.641001:0:6517:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004881399s 00010000:00010000:1.0:1789302081.641005:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.641012:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.641027:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.641033:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.641038:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000049f66373 already unused, calling callback (000000006b2f69eb) 00010000:00010000:1.0:1789302081.641042:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.641049:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.641062:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.641071:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302081.641098:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ab1b80a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+14:3648:x1876219121377792:12345-0@lo:103: Request processed in 225us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.641103:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789302081.641168:0:6546:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.641176:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302081.641181:0:6546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000049f66373/0x1ff82925bd398fa4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302081.641254:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000657fd2d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121377792:0@lo:103: 00000100:00100000:3.0:1789302081.642192:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000aa73b3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+13:7460:x1876219121377280:12345-0@lo:253: Request processed in 7596us (21330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302081.642203:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789302081.642502:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f2fd232 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:7460:1876219121377280:0@lo:253: 10000000:01000000:0.0:1789302081.642515:0:7460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789302081.642517:0:7460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789302081.642519:0:7460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789302081.642521:0:7460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302081.642522:0:7460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302081.642523:0:7460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302081.642524:0:7460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302081.642525:0:7460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789302081.642526:0:7460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302081.642527:0:7460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302081.642529:0:7460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302081.642530:0:7460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789302081.642540:0:7460:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789302081.643195:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062f059cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121377664:0@lo:103: 00080000:10000000:1.0:1789302081.651782:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1789302081.652078:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789302081.652843:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789302081.653105:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789302081.653689:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789302081.653879:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789302081.654875:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789302081.655240:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789302081.655657:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789302081.655821:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789302081.656063:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789302081.656632:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1789302081.658647:0:7460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789302081.658853:0:7483:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789302081.658858:0:7483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789302081.659087:0:7484:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1789302081.659166:0:7484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021e2c7fe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7484:1876219121377920:0@lo:700: 00000100:00100000:2.0:1789302081.659236:0:7484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302081.659289:0:7484:0:(client.c:2716:ptlrpc_set_wait()) set 00000000772ff25b going to sleep for 11 seconds 00000100:00100000:1.0:1789302081.659450:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121377920 00000100:00100000:1.0:1789302081.659458:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121377920 00000100:00100000:1.0:1789302081.659496:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302081.659505:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000029e7f99e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7484:x1876219121377920:12345-0@lo:700: 00000040:01000000:3.0:1789302081.659705:0:7460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789302081.660103:0:7485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da2479fd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1876219121378048:0@lo:1000: 00000100:00100000:1.0:1789302081.660168:0:7485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1789302081.660849:0:7460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1789302081.661086:0:7485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e732bcc2 going to sleep for 11 seconds 00000040:00080000:3.0:1789302081.661456:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789302081.662226:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121378048 00000100:00100000:0.0:1789302081.662236:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121378048 00000004:00000080:3.0:1789302081.662385:0:7460:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789302081.662393:0:7460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789302081.662578:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302081.664369:0:7460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789302081.667598:0:7460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789302081.667709:0:7460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789302081.668257:0:7460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789302081.668967:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302081.668978:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d694eb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1876219121378048:12345-0@lo:1000: 00000100:00100000:2.0:1789302081.669104:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d694eb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1876219121378048:12345-0@lo:1000: Request processed in 128us (8935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.669131:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302081.669207:0:7485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da2479fd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1876219121378048:0@lo:1000: 00000040:01000000:2.0:1789302081.669240:0:7485:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789302081.669286:0:7485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000effa7888 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1876219121378176:0@lo:700: 00000100:00100000:2.0:1789302081.669332:0:7485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302081.669379:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121378176 00000100:00100000:2.0:1789302081.669388:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121378176 00000100:00100000:2.0:1789302081.669420:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302081.669426:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca7e0465 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7485:x1876219121378176:12345-0@lo:700: 00000100:00100000:2.0:1789302081.669462:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca7e0465 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7485:x1876219121378176:12345-0@lo:700: Request processed in 37us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.669474:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302081.669509:0:7485:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c589afd going to sleep for 11 seconds 00000100:00100000:2.0:1789302081.669655:0:7485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000effa7888 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1876219121378176:0@lo:700: 00000100:00100000:2.0:1789302081.669703:0:7485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000effa7888 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7485:1876219121378304:0@lo:900: 00000100:00100000:2.0:1789302081.669730:0:7485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302081.669759:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121378304 00000100:00100000:2.0:1789302081.669763:0:6541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121378304 00000100:00100000:2.0:1789302081.669787:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302081.669796:0:6541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f420083 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7485:x1876219121378304:12345-0@lo:900: 00000100:00100000:2.0:1789302081.669843:0:6541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f420083 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7485:x1876219121378304:12345-0@lo:900: Request processed in 51us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.669850:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302081.669870:0:7485:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c589afd going to sleep for 11 seconds 00010000:00080000:2.0:1789302081.669886:0:7485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000effa7888 x1876219121378304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789302097 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302081.669903:0:7485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000effa7888 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7485:1876219121378304:0@lo:900: 00000100:00100000:2.0:1789302081.670035:0:7485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000effa7888 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1876219121378432:0@lo:1000: 00000100:00100000:2.0:1789302081.670063:0:7485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302081.670086:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121378432 00000100:00100000:2.0:1789302081.670089:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121378432 00000100:00100000:2.0:1789302081.670143:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789302081.670153:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062f059cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1876219121378432:12345-0@lo:1000: 00000100:00100000:2.0:1789302081.670202:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062f059cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1876219121378432:12345-0@lo:1000: Request processed in 50us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302081.670207:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789302081.670373:0:7485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2b1891c going to sleep for 11 seconds 00000100:00100000:2.0:1789302081.670387:0:7485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000effa7888 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1876219121378432:0@lo:1000: 00000004:00080000:2.0:1789302081.670429:0:7485:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000008c589afd with version 0 00000020:00100000:2.0:1789302081.670445:0:7485:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789302081.670450:0:7485:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000effa7888 x1876219121378688/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789302081.670464:0:7485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000effa7888 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1876219121378688:0@lo:1000: 00000100:00100000:2.0:1789302081.670488:0:7485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302081.670508:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121378688 00000100:00100000:2.0:1789302081.670512:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121378688 00000100:00100000:2.0:1789302081.670532:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302081.670537:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f2fd232 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1876219121378688:12345-0@lo:1000: 00000100:00100000:2.0:1789302081.672092:0:7485:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044d50b23 going to sleep for 11 seconds 00080000:10000000:3.0:1789302081.672375:0:7460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789302081.673016:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789302081.673175:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789302081.673349:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789302081.673491:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789302081.673660:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789302081.673871:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789302081.674010:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789302081.674188:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789302081.674349:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789302081.674480:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789302081.675785:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789302081.676180:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789302081.676463:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789302081.676603:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789302081.676857:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789302081.677061:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789302081.677957:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789302081.678105:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789302081.678286:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789302081.678611:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789302081.678760:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789302081.679016:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789302081.679195:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789302081.680477:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789302081.680673:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789302081.680812:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 40000000:02000000:1.0:1789302081.681373:0:6537:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:3.0:1789302081.686512:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000001:00080000:0.0:1789302081.686691:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1789302081.687184:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f2fd232 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7485:x1876219121378688:12345-0@lo:1000: Request processed in 16643us (16691us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789302081.687195:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:3.0:1789302081.687447:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789302081.687588:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789302081.687739:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789302081.687886:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789302081.688224:0:7460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789302081.691690:0:7460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:0.0:1789302081.691865:0:7485:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789302081.691870:0:7485:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789302081.691886:0:7485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000effa7888 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1876219121378688:0@lo:1000: 00000100:00100000:0.0:1789302081.692004:0:7485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000904dd4f8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1876219121378816:0@lo:1000: 00000100:00100000:0.0:1789302081.692064:0:7485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302081.692100:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121378816 00000100:00100000:0.0:1789302081.692107:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121378816 00000100:00100000:0.0:1789302081.692165:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302081.692174:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000042034fdc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7485:x1876219121378816:12345-0@lo:1000: 00000100:00100000:0.0:1789302081.692253:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000042034fdc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7485:x1876219121378816:12345-0@lo:1000: Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302081.692271:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302081.692323:0:7485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000436b55e1 going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.692336:0:7485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000904dd4f8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7485:1876219121378816:0@lo:1000: 00000040:00080000:0.0:1789302081.692352:0:7485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789302081.692377:0:7485:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000627744b1 with version 1 00000004:00080000:0.0:1789302081.692394:0:7475:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000009507b13a version 1 rpc_version 1 00000020:00100000:0.0:1789302081.692408:0:7475:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789302081.692416:0:7475:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000904dd4f8 x1876219121379072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302081.692429:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000904dd4f8 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7475:1876219121379072:0@lo:1000: 00000100:00100000:0.0:1789302081.692453:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302081.692467:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 000000007301cb3b going to sleep for 11 seconds 00000100:00100000:0.0:1789302081.692481:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121379072 00000100:00100000:0.0:1789302081.692484:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121379072 00000100:00100000:0.0:1789302081.692504:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302081.692509:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000019f6b62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876219121379072:12345-0@lo:1000: 00000040:00080000:0.0:1789302081.694561:0:7485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000100:00100000:1.0:1789302081.700202:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000029e7f99e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7484:x1876219121377920:12345-0@lo:700: Request processed in 40689us (40957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302081.700218:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789302081.701607:0:7484:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000021e2c7fe x1876219121377920/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789302097 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302081.701641:0:7484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021e2c7fe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7484:1876219121377920:0@lo:700: 40000000:02000000:1.0:1789302081.701656:0:7484:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:0.0:1789302081.702495:0:7485:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:3.0:1789302081.709056:0:7460:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789302081.709097:0:7460:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffadc441c8f988 00100000:10000000:3.0:1789302081.709104:0:7460:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000001:00080000:0.0:1789302081.710026:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1789302081.710160:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000019f6b62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876219121379072:12345-0@lo:1000: Request processed in 17647us (17702us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789302081.710172:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1789302081.710226:0:7475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789302081.710231:0:7475:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789302081.710245:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000904dd4f8 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7475:1876219121379072:0@lo:1000: 00000020:01000004:2.0:1789302081.712181:0:7460:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789302081.712210:0:7460:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789302081.712228:0:7460:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789302081.712250:0:7460:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789302081.715210:0:7460:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789302081.717580:0:7460:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1789302081.764018:0:7484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302081.773670:0:7484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789302081.773753:0:7484:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789302081.773758:0:7484:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1789302081.949800:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302082.971348:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302083.988888:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302085.020643:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302086.036389:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302086.742445:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000904dd4f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121379200:0@lo:41: 00000100:00100000:0.0:1789302086.742521:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302086.742597:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121379200 00000100:00100000:0.0:1789302086.742604:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121379200 00000100:00100000:0.0:1789302086.742645:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302086.742652:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e1243dbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121379200:12345-0@lo:41: 00000004:00000024:0.0:1789302086.742686:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789302086.742732:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e1243dbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121379200:12345-0@lo:41: Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302086.742739:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302086.742783:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000904dd4f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121379200:0@lo:41: 00000100:00100000:0.0:1789302086.748487:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121379456:0@lo:400: 00000100:00100000:0.0:1789302086.748574:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302086.748624:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302086.748630:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000904dd4f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121379328:0@lo:400: 00000100:00100000:0.0:1789302086.748659:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302086.748698:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121379456 00000100:00100000:0.0:1789302086.748705:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121379456 00000100:00100000:0.0:1789302086.748744:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302086.748751:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e375a09f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121379456:12345-0@lo:400: 00000100:00100000:0.0:1789302086.748811:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e375a09f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121379456:12345-0@lo:400: Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302086.748819:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302086.748847:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121379328 00000100:00100000:0.0:1789302086.748851:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121379328 00000100:00100000:0.0:1789302086.748873:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789302086.748878:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a8875601 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+13:3646:x1876219121379328:12345-0@lo:400: 00000100:00100000:0.0:1789302086.748920:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a8875601 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+13:3646:x1876219121379328:12345-0@lo:400: Request processed in 42us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302086.748926:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789302086.748953:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121379584:0@lo:400: 00000100:00100000:0.0:1789302086.748978:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302086.749006:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121379584 00000100:00100000:0.0:1789302086.749009:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121379584 00000100:00100000:0.0:1789302086.749029:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789302086.749034:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e4055cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121379584:12345-0@lo:400: 00000100:00100000:0.0:1789302086.749063:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e4055cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121379584:12345-0@lo:400: Request processed in 29us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302086.749069:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789302086.749103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000d8ac0f2 x1876219121379584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302086.749134:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121379584:0@lo:400: 00000100:00100000:0.0:1789302086.749177:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000904dd4f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121379328:0@lo:400: 00010000:00080000:0.0:1789302086.749185:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000096722c76 x1876219121379456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302086.749206:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121379456:0@lo:400: 00000001:02000400:1.0:1789302086.980397:0:7730:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789302087.060329:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789302088.044311:0:7782:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789302088.044493:0:7782:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789302088.084595:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302089.109500:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302090.134200:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789302090.836418:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789302090.836426:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b511e800 from 4 10000000:01000000:2.0:1789302090.836430:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789302090.836475:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 00000000b39d79a1/0x1ff82925bd398fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302090.836500:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 00000000b39d79a1/0x1ff82925bd398fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302090.836510:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 00000000b39d79a1/0x1ff82925bd398fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302090.836531:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000657fd2d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121379712:0@lo:101: 00000100:00100000:2.0:1789302090.836612:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302090.836660:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e6d0bde going to sleep for 11 seconds 00000100:00100000:3.0:1789302090.836713:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121379712 00000100:00100000:3.0:1789302090.836722:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121379712 00000100:00100000:3.0:1789302090.836776:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789302090.836784:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000faedecde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+13:6527:x1876219121379712:12345-0@lo:101: 00010000:00010000:3.0:1789302090.836797:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302090.836810:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0261dc2/0x1ff82925bd398fb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398fab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.836832:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0261dc2/0x1ff82925bd398fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398fab expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.836842:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0261dc2/0x1ff82925bd398fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398fab expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.836858:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0261dc2, rc 0) 00000100:00100000:3.0:1789302090.836904:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000faedecde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+14:6527:x1876219121379712:12345-0@lo:101: Request processed in 122us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302090.836910:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789302090.837052:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000657fd2d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121379712:0@lo:101: 00010000:00010000:2.0:1789302090.837064:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 00000000b39d79a1/0x1ff82925bd398fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302090.837072:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 00000000b39d79a1/0x1ff82925bd398fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302090.837155:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000657fd2d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121379840:0@lo:256: 00000100:00100000:2.0:1789302090.837186:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302090.837200:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e6d0bde going to sleep for 11 seconds 00000100:00100000:0.0:1789302090.837270:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121379840 00000100:00100000:0.0:1789302090.837275:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121379840 00000100:00100000:0.0:1789302090.837302:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789302090.837308:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b926555 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+14:6527:x1876219121379840:12345-0@lo:256: 20000000:01000000:0.0:1789302090.837321:0:6525:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789302090.837338:0:6525:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789302090.837342:0:6525:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789302090.837423:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b926555 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+14:6527:x1876219121379840:12345-0@lo:256: Request processed in 114us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302090.837430:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789302090.837710:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000657fd2d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121379840:0@lo:256: 10000000:01000000:2.0:1789302090.837750:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789302090.837756:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 00000000b39d79a1/0x1ff82925bd398fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302090.837764:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 00000000b39d79a1/0x1ff82925bd398fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302090.837783:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789302090.837785:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4b863d000 from 21 10000000:01000000:2.0:1789302090.837787:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789302090.837804:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 00000000b78d4ebc/0x1ff82925bd398fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302090.837811:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 00000000b78d4ebc/0x1ff82925bd398fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302090.837818:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 00000000b78d4ebc/0x1ff82925bd398fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302090.837828:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000657fd2d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121379968:0@lo:101: 00000100:00100000:2.0:1789302090.837855:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302090.837883:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 000000006e6d0bde going to sleep for 11 seconds 00000100:00100000:0.0:1789302090.837932:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121379968 00000100:00100000:0.0:1789302090.837937:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121379968 00000100:00100000:0.0:1789302090.837969:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302090.837975:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009490c6d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+14:6527:x1876219121379968:12345-0@lo:101: 00010000:00010000:0.0:1789302090.837983:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302090.837991:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000096a7644e/0x1ff82925bd398fc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398fb9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.838005:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096a7644e/0x1ff82925bd398fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398fb9 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.838012:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000096a7644e/0x1ff82925bd398fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398fb9 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.838018:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000096a7644e, rc 0) 00000100:00100000:0.0:1789302090.838095:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009490c6d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121379968:12345-0@lo:101: Request processed in 121us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302090.838102:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789302090.849875:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000657fd2d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121379968:0@lo:101: 00010000:00010000:1.0:1789302090.849906:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 00000000b78d4ebc/0x1ff82925bd398fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302090.849918:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 00000000b78d4ebc/0x1ff82925bd398fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302090.850045:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017534731 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380096:0@lo:501: 00000100:00100000:1.0:1789302090.850498:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302090.850541:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d3e1ffa going to sleep for 11 seconds 00000100:00100000:3.0:1789302090.850585:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121380096 00000100:00100000:3.0:1789302090.850593:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121380096 00000100:00100000:3.0:1789302090.850645:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789302090.850654:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000cc45c09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121380096:12345-0@lo:501: 00000100:00100000:3.0:1789302090.850790:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000cc45c09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121380096:12345-0@lo:501: Request processed in 138us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302090.850798:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789302090.851837:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017534731 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380096:0@lo:501: 00000100:00100000:1.0:1789302090.851884:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017534731 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380224:0@lo:503: 00000100:00100000:1.0:1789302090.851941:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302090.851988:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d3e1ffa going to sleep for 11 seconds 00000100:00100000:2.0:1789302090.852155:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121380224 00000100:00100000:2.0:1789302090.852163:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121380224 00000100:00100000:2.0:1789302090.852215:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789302090.852223:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a05cff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121380224:12345-0@lo:503: 00000100:00100000:2.0:1789302090.852327:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a05cff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121380224:12345-0@lo:503: Request processed in 105us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302090.852335:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789302090.852413:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017534731 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380224:0@lo:503: 00000100:00100000:3.0:1789302090.852753:0:7864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002168c418 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:7864:1876219121380352:0@lo:502: 00000100:00100000:3.0:1789302090.852791:0:7864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302090.852819:0:7864:0:(client.c:2716:ptlrpc_set_wait()) set 00000000744704e5 going to sleep for 11 seconds 00000100:00100000:0.0:1789302090.852857:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121380352 00000100:00100000:0.0:1789302090.852863:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121380352 00000100:00100000:0.0:1789302090.852897:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789302090.852904:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ed56b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:7864:x1876219121380352:12345-0@lo:502: 00000100:00100000:0.0:1789302090.852994:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ed56b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:7864:x1876219121380352:12345-0@lo:502: Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302090.853001:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789302090.853026:0:7864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002168c418 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:7864:1876219121380352:0@lo:502: 00000100:00100000:1.0:1789302090.853078:0:7864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000825fc10f pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:7864:1876219121380480:0@lo:502: 00000100:00100000:1.0:1789302090.853156:0:7864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302090.853190:0:7864:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076582080 going to sleep for 11 seconds 00000100:00100000:2.0:1789302090.854830:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121380480 00000100:00100000:2.0:1789302090.854843:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121380480 00000100:00100000:2.0:1789302090.854900:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789302090.854908:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060e34509 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:7864:x1876219121380480:12345-0@lo:502: 00000100:00100000:2.0:1789302090.855049:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060e34509 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:7864:x1876219121380480:12345-0@lo:502: Request processed in 141us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302090.855073:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789302090.855488:0:7864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000825fc10f pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:7864:1876219121380480:0@lo:502: 00000040:00080000:1.0:1789302090.855522:0:7864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789302090.855755:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789302090.855778:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789302090.855788:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 00000000b78d4ebc/0x1ff82925bd398fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.855798:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 00000000b78d4ebc/0x1ff82925bd398fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302090.855806:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789302090.855808:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b863d000 from 4 10000000:01000000:0.0:1789302090.855810:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789302090.855839:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 000000004378f1f1/0x1ff82925bd398fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.855846:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 000000004378f1f1/0x1ff82925bd398fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.855854:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 000000004378f1f1/0x1ff82925bd398fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302090.855881:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380608:0@lo:101: 00000100:00100000:0.0:1789302090.855920:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302090.855956:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7dd27df going to sleep for 11 seconds 00000100:00100000:3.0:1789302090.856013:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121380608 00000100:00100000:3.0:1789302090.856020:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121380608 00000100:00100000:3.0:1789302090.856056:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789302090.856064:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000075586e8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121380608:12345-0@lo:101: 00010000:00010000:3.0:1789302090.856073:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302090.856084:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000318aeafc/0x1ff82925bd398fce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398fc7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.856105:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000318aeafc/0x1ff82925bd398fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398fc7 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.856156:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000318aeafc/0x1ff82925bd398fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398fc7 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.856163:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000318aeafc, rc 0) 00000100:00100000:3.0:1789302090.856198:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000075586e8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121380608:12345-0@lo:101: Request processed in 135us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302090.856204:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789302090.856286:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380608:0@lo:101: 00010000:00010000:0.0:1789302090.856297:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 000000004378f1f1/0x1ff82925bd398fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.856304:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 000000004378f1f1/0x1ff82925bd398fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302090.856349:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380736:0@lo:256: 00000100:00100000:0.0:1789302090.856392:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302090.856417:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7dd27df going to sleep for 11 seconds 00000100:00100000:1.0:1789302090.857912:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121380736 00000100:00100000:1.0:1789302090.857924:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121380736 00000100:00100000:3.0:1789302090.858700:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789302090.858717:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044c3896c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121380736:12345-0@lo:256: 20000000:01000000:3.0:1789302090.858741:0:6523:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789302090.858763:0:6523:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789302090.858767:0:6523:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789302090.858897:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044c3896c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121380736:12345-0@lo:256: Request processed in 187us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302090.858906:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789302090.858960:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380736:0@lo:256: 10000000:01000000:3.0:1789302090.859015:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789302090.859024:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 000000004378f1f1/0x1ff82925bd398fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.859034:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 000000004378f1f1/0x1ff82925bd398fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302090.859043:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789302090.859045:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789302090.859048:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789302090.859075:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 0000000078d3b9df/0x1ff82925bd398fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.859086:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 0000000078d3b9df/0x1ff82925bd398fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.859096:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 0000000078d3b9df/0x1ff82925bd398fd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302090.859133:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e19a2346 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380864:0@lo:101: 00000100:00100000:3.0:1789302090.859164:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302090.859189:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 0000000088aa96df going to sleep for 11 seconds 00000100:00100000:3.0:1789302090.859201:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121380864 00000100:00100000:3.0:1789302090.859205:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121380864 00000100:00100000:3.0:1789302090.859225:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789302090.859231:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012477ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121380864:12345-0@lo:101: 00010000:00010000:3.0:1789302090.859252:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302090.859262:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008aefa71c/0x1ff82925bd398fdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398fd5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.859280:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008aefa71c/0x1ff82925bd398fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398fd5 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.859287:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008aefa71c/0x1ff82925bd398fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398fd5 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.859295:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008aefa71c, rc 0) 00000100:00100000:3.0:1789302090.859321:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012477ca0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121380864:12345-0@lo:101: Request processed in 90us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302090.859326:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789302090.859354:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e19a2346 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380864:0@lo:101: 00010000:00010000:3.0:1789302090.859370:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 0000000078d3b9df/0x1ff82925bd398fd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302090.859378:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 0000000078d3b9df/0x1ff82925bd398fd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302090.859426:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e19a2346 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380992:0@lo:501: 00000100:00100000:3.0:1789302090.859450:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302090.859477:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 0000000088aa96df going to sleep for 11 seconds 00000100:00100000:2.0:1789302090.859511:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121380992 00000100:00100000:2.0:1789302090.859516:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121380992 00000100:00100000:2.0:1789302090.859547:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789302090.859561:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004492d1c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121380992:12345-0@lo:501: 00000100:00100000:2.0:1789302090.859673:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004492d1c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121380992:12345-0@lo:501: Request processed in 121us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302090.859680:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789302090.859729:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e19a2346 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121380992:0@lo:501: 00000100:00100000:3.0:1789302090.859755:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e19a2346 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121381120:0@lo:503: 00000100:00100000:3.0:1789302090.859792:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302090.859813:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 0000000088aa96df going to sleep for 11 seconds 00000100:00100000:2.0:1789302090.859865:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121381120 00000100:00100000:2.0:1789302090.859869:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121381120 00000100:00100000:2.0:1789302090.859896:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789302090.859902:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002395c2e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121381120:12345-0@lo:503: 00000100:00100000:2.0:1789302090.860051:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002395c2e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121381120:12345-0@lo:503: Request processed in 149us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302090.860057:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789302090.861606:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e19a2346 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121381120:0@lo:503: 00000100:00100000:2.0:1789302090.871794:0:7865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d688560 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:7865:1876219121381248:0@lo:502: 00000100:00100000:2.0:1789302090.871877:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302090.871921:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000712f033a going to sleep for 11 seconds 00000100:00100000:1.0:1789302090.872164:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121381248 00000100:00100000:1.0:1789302090.872172:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121381248 00000100:00100000:1.0:1789302090.872219:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789302090.872227:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fb492da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:7865:x1876219121381248:12345-0@lo:502: 00000100:00100000:1.0:1789302090.872341:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fb492da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:7865:x1876219121381248:12345-0@lo:502: Request processed in 115us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302090.872349:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789302090.872907:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d688560 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:7865:1876219121381248:0@lo:502: 00000020:01000000:2.0:1789302090.872937:0:7865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302090.872948:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302090.872950:0:7865:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789302090.872955:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789302090.872959:0:7865:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:00000080:2.0:1789302090.872992:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789302090.873006:0:7865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000003c964cef) 00000020:00000080:2.0:1789302090.873024:0:7865:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1789302090.873035:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789302090.873174:0:7865:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789302090.873179:0:7865:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789302090.873186:0:7865:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd398fea 00010000:00080000:2.0:1789302090.873564:0:7865:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007c2d40ff@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.109@tcp at head 00010000:00010000:2.0:1789302090.876627:0:7865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1789302090.878832:0:7865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789302090.878847:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789302090.878879:0:7865:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789302090.878901:0:7865:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd398ff1 00000100:00080000:2.0:1789302090.878911:0:7865:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789302090.878922:0:7865:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000007c2d40ff using connection 192.168.203.109@tcp/0@lo 00000100:00100000:2.0:1789302090.878956:0:7865:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005d688560 x1876219121381376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302090.879013:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d688560 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121381376:0@lo:38: 00000100:00100000:1.0:1789302090.879306:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789302090.879489:0:7865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1789302090.879538:0:7865:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1789302090.879925:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121381376 00000100:00100000:0.0:1789302090.879933:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121381376 00000100:00100000:0.0:1789302090.879969:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789302090.879975:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000825fc10f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876219121381376:12345-0@lo:38: 00010000:00080000:0.0:1789302090.879999:0:6536:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:0.0:1789302090.880030:0:6536:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd398ff8 00000004:00100000:0.0:1789302090.880043:0:6536:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789302090.880048:0:6536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789302090.880170:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e7ba030 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121381504:0@lo:400: 00000100:00100000:3.0:1789302090.880209:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302090.880964:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000034f11595 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121381632:0@lo:400: 00000100:00100000:3.0:1789302090.881002:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789302090.881021:0:7869:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000904dd4f8 x1876219121381888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302090.881030:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a007b9d going to sleep for 0 seconds 00000100:00100000:3.0:1789302090.881037:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302090.881041:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abb55d7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121381760:0@lo:400: 00000100:00100000:3.0:1789302090.881067:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302090.881106:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121381504 00000100:00100000:3.0:1789302090.881158:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121381504 00000100:00100000:0.0:1789302090.881165:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121381760 00000100:00100000:0.0:1789302090.881168:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121381760 00000100:00100000:1.0:1789302090.881227:0:6535:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000020:01000000:2.0:1789302090.881404:0:7865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302090.881411:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302090.881413:0:7865:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789302090.881416:0:7865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302090.881420:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302090.881422:0:7865:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789302090.881424:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789302090.881426:0:7865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789302090.881445:0:7865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018842b4e pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:7865:1876219121382016:0@lo:502: 00000100:00100000:2.0:1789302090.881571:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302090.881595:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121382016 00000100:00100000:2.0:1789302090.881598:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121382016 00000100:00100000:2.0:1789302090.881630:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789302090.881636:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004ba09bda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:7865:x1876219121382016:12345-0@lo:502: 00000100:00100000:1.0:1789302090.881718:0:6535:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789302090.881829:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004ba09bda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:7865:x1876219121382016:12345-0@lo:502: Request processed in 193us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302090.881837:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789302090.881982:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6dd34cd going to sleep for 11 seconds 00000100:00100000:2.0:1789302090.882001:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018842b4e pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:7865:1876219121382016:0@lo:502: 00000020:01000000:2.0:1789302090.882024:0:7865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302090.882028:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302090.882030:0:7865:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789302090.882033:0:7865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1789302090.882174:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121381632 00000100:00100000:1.0:1789302090.882179:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121381632 00000100:00100000:1.0:1789302090.882268:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302090.882275:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c7ef4c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121381632:12345-0@lo:400: 00000100:00100000:1.0:1789302090.882327:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c7ef4c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121381632:12345-0@lo:400: Request processed in 53us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302090.882334:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789302090.882430:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000034f11595 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121381632:0@lo:400: 00000100:00100000:0.0:1789302090.882568:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302090.882577:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000037e1eb61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121381504:12345-0@lo:400: 00000100:00100000:0.0:1789302090.882652:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000037e1eb61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121381504:12345-0@lo:400: Request processed in 77us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302090.882658:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302090.882671:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302090.882676:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e19a2346 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121381760:12345-0@lo:400: 00000100:00100000:0.0:1789302090.882778:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e19a2346 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121381760:12345-0@lo:400: Request processed in 102us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302090.882785:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000000:0.0:1789302090.882804:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789302090.882827:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789302090.882835:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 0000000078d3b9df/0x1ff82925bd398fd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.882844:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 0000000078d3b9df/0x1ff82925bd398fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302090.882853:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789302090.882855:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cc4ac2ab380 from 1 10000000:01000000:0.0:1789302090.882858:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789302090.882879:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 000000002fea0594/0x1ff82925bd398fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.882885:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 000000002fea0594/0x1ff82925bd398fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.882906:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 000000002fea0594/0x1ff82925bd398fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302090.882922:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121382144:0@lo:101: 00000100:00100000:0.0:1789302090.882951:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302090.882973:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028266ef2 going to sleep for 11 seconds 00000100:00100000:0.0:1789302090.882985:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121382144 00000100:00100000:0.0:1789302090.882989:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121382144 00000100:00100000:0.0:1789302090.883011:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789302090.883017:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000c30719f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121382144:12345-0@lo:101: 00010000:00010000:0.0:1789302090.883025:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302090.883035:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cf136b5a/0x1ff82925bd399006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd398fff expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.883055:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cf136b5a/0x1ff82925bd399006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd398fff expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.883283:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cf136b5a/0x1ff82925bd399006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398fff expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.883291:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cf136b5a, rc 0) 00000100:00100000:0.0:1789302090.883319:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000c30719f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121382144:12345-0@lo:101: Request processed in 303us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302090.883326:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789302090.883356:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121382144:0@lo:101: 00010000:00010000:0.0:1789302090.883367:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 000000002fea0594/0x1ff82925bd398fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.883385:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 000000002fea0594/0x1ff82925bd398fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302090.883430:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121382272:0@lo:501: 00000100:00100000:0.0:1789302090.883452:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302090.883540:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028266ef2 going to sleep for 11 seconds 00000100:00100000:0.0:1789302090.883565:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121382272 00000100:00100000:0.0:1789302090.883569:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121382272 00000100:00100000:0.0:1789302090.883592:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789302090.883597:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000000b2963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121382272:12345-0@lo:501: 00000100:00100000:0.0:1789302090.883662:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000000b2963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121382272:12345-0@lo:501: Request processed in 65us (209us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302090.883668:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789302090.883696:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121382272:0@lo:501: 00010000:00080000:1.0:1789302090.883757:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000abb55d7d x1876219121381760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302090.883769:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abb55d7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121381760:0@lo:400: 10000000:01000000:0.0:1789302090.883787:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789302090.883792:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: 000000002fea0594/0x1ff82925bd398fff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302090.883798:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: 000000002fea0594/0x1ff82925bd398fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1789302090.885382:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008e7ba030 x1876219121381504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302090.885398:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e7ba030 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121381504:0@lo:400: 00000100:00080000:2.0:1789302090.898061:0:6536:0:(import.c:65:import_set_state_nolock()) 00000000e7a2fc8a : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302090.898225:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000825fc10f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876219121381376:12345-0@lo:38: Request processed in 18247us (18918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302090.898234:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789302090.898355:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789302090.898369:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789302090.898382:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789302090.898390:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789302090.898395:0:3644:0:(import.c:65:import_set_state_nolock()) 000000007c2d40ff lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789302090.898425:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002a007b9d): req@00000000904dd4f8 x1876219121381888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302090.898454:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d688560 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121381376:0@lo:38: 00000100:00100000:3.0:1789302090.898662:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302090.898726:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a007b9d going to sleep for 11 seconds 00000100:00100000:1.0:1789302090.898776:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121381888 00000100:00100000:1.0:1789302090.898783:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121381888 00000100:00100000:1.0:1789302090.898835:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302090.898848:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002168c418 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7869:x1876219121381888:12345-0@lo:1000: 00000100:00100000:1.0:1789302090.898941:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002168c418 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7869:x1876219121381888:12345-0@lo:1000: Request processed in 97us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302090.898948:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789302090.899065:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000904dd4f8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7869:1876219121381888:0@lo:1000: 00000040:01000000:3.0:1789302090.899152:0:7869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789302090.899226:0:7869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7869:1876219121382400:0@lo:1000: 00000100:00100000:3.0:1789302090.899281:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302090.899307:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set 000000009022b4ca going to sleep for 11 seconds 00000100:00100000:3.0:1789302090.899329:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121382400 00000100:00100000:3.0:1789302090.899338:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121382400 00000100:00100000:3.0:1789302090.899370:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789302090.899376:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f12c61ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7869:x1876219121382400:12345-0@lo:1000: 00000100:00100000:3.0:1789302090.899502:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f12c61ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7869:x1876219121382400:12345-0@lo:1000: Request processed in 125us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302090.899509:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789302090.899537:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7869:1876219121382400:0@lo:1000: 00000100:00100000:3.0:1789302090.899585:0:7869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7869:1876219121382528:0@lo:700: 00000100:00100000:3.0:1789302090.899614:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302090.899629:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070a54961 going to sleep for 11 seconds 00000100:00100000:2.0:1789302090.901708:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121382528 00000100:00100000:2.0:1789302090.901720:0:6540:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121382528 00000100:00100000:2.0:1789302090.901772:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302090.901780:0:6540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000085eb0071 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7869:x1876219121382528:12345-0@lo:700: 00000100:00100000:2.0:1789302090.901872:0:6540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000085eb0071 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7869:x1876219121382528:12345-0@lo:700: Request processed in 94us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302090.901880:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302090.901947:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018842b4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121382656:0@lo:41: 00000100:00100000:0.0:1789302090.901965:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7869:1876219121382528:0@lo:700: 00000100:00100000:2.0:1789302090.901990:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302090.902252:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121382656 00000100:00100000:3.0:1789302090.902257:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121382656 00000100:00100000:3.0:1789302090.902293:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789302090.902300:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084f68abe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121382656:12345-0@lo:41: 00000004:00000024:3.0:1789302090.902325:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789302090.902373:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084f68abe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121382656:12345-0@lo:41: Request processed in 74us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302090.902379:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302090.902386:0:7869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7869:1876219121382784:0@lo:1000: 00000100:00100000:0.0:1789302090.902419:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302090.902448:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd4d9107 going to sleep for 11 seconds 00000100:00100000:3.0:1789302090.903770:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121382784 00000100:00100000:3.0:1789302090.903780:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121382784 00000100:00100000:3.0:1789302090.903828:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789302090.903835:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009b94494 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7869:x1876219121382784:12345-0@lo:1000: 00000100:00100000:3.0:1789302090.903921:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009b94494 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7869:x1876219121382784:12345-0@lo:1000: Request processed in 86us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302090.903932:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789302090.904061:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018842b4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121382656:0@lo:41: 00000100:00100000:0.0:1789302090.904256:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7869:1876219121382784:0@lo:1000: 00000004:00080000:0.0:1789302090.904307:0:7869:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000009221ff26 with version 0 00000020:00100000:0.0:1789302090.904324:0:7869:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789302090.904330:0:7869:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000d8ac0f2 x1876219121383040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302090.904345:0:7869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7869:1876219121383040:0@lo:1000: 00000100:00100000:0.0:1789302090.904384:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302090.904404:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdd80ad4 going to sleep for 11 seconds 00000100:00100000:1.0:1789302090.904469:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121383040 00000100:00100000:1.0:1789302090.904474:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121383040 00000100:00100000:1.0:1789302090.904498:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789302090.904504:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000076861de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7869:x1876219121383040:12345-0@lo:1000: 00000001:00080000:1.0:1789302090.917499:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1789302090.917513:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789302090.918820:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000076861de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7869:x1876219121383040:12345-0@lo:1000: Request processed in 14309us (14429us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789302090.918833:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1789302090.918883:0:7869:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789302090.918887:0:7869:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789302090.918900:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7869:1876219121383040:0@lo:1000: 00000100:00100000:0.0:1789302090.919001:0:7869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7869:1876219121383168:0@lo:1000: 00000100:00100000:0.0:1789302090.919037:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302090.919077:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd4d9107 going to sleep for 11 seconds 00000100:00100000:3.0:1789302090.919573:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121383168 00000100:00100000:3.0:1789302090.919581:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121383168 00000100:00100000:3.0:1789302090.919628:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789302090.919634:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ba1207c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7869:x1876219121383168:12345-0@lo:1000: 00000100:00100000:3.0:1789302090.919701:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ba1207c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7869:x1876219121383168:12345-0@lo:1000: Request processed in 67us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302090.919707:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789302090.920059:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7869:1876219121383168:0@lo:1000: 00000040:00080000:0.0:1789302090.920080:0:7869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789302090.920131:0:7869:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000fdd80ad4 with version 1 00000004:00080000:3.0:1789302090.920172:0:7867:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000008d930658 version 1 rpc_version 1 00000020:00100000:3.0:1789302090.920191:0:7867:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789302090.920198:0:7867:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000fab6e680 x1876219121383424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789302090.920320:0:7867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7867:1876219121383424:0@lo:1000: 00000100:00100000:3.0:1789302090.920350:0:7867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302090.920375:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121383424 00000100:00100000:3.0:1789302090.920378:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121383424 00000100:00100000:3.0:1789302090.920400:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789302090.920405:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca2b9e79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7867:x1876219121383424:12345-0@lo:1000: 00000100:00100000:3.0:1789302090.920644:0:7867:0:(client.c:2716:ptlrpc_set_wait()) set 000000009022b4ca going to sleep for 11 seconds 00000040:00080000:0.0:1789302090.922251:0:7869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789302090.922332:0:7869:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789302090.922336:0:7869:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1789302090.925820:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1789302090.926043:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca2b9e79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7867:x1876219121383424:12345-0@lo:1000: Request processed in 5634us (5689us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789302090.926056:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1789302090.926425:0:7867:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789302090.926432:0:7867:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789302090.926449:0:7867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fab6e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7867:1876219121383424:0@lo:1000: 00000020:00000004:3.0:1789302091.012201:0:7889:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789302091.012476:0:7889:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789302091.157998:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302091.860540:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121383552:0@lo:41: 00000100:00100000:3.0:1789302091.860630:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302091.860744:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121383552 00000100:00100000:0.0:1789302091.860752:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121383552 00000100:00100000:0.0:1789302091.860831:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789302091.860840:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fab6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121383552:12345-0@lo:41: 00000004:00000024:0.0:1789302091.860872:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789302091.860920:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fab6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121383552:12345-0@lo:41: Request processed in 81us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302091.860927:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789302091.864007:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d8ac0f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121383552:0@lo:41: 00000020:00000080:2.0:1789302092.166562:0:7937:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4ec592c0 20000000:00000080:2.0:1789302092.166580:0:7937:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cc4ade03c00 uarg=0000000000000000 20000000:01000000:2.0:1789302092.166683:0:7937:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789302092.166690:0:7937:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789302092.166694:0:7937:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789302092.166776:0:7937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789302092.166787:0:7937:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789302092.172709:0:7937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302092.173005:0:7937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789302092.173043:0:7937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789302092.173061:0:7937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789302092.173076:0:7937:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789302092.173093:0:7937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302092.173147:0:7937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ad7ae9ec/0x1ff82925bd398e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398e85 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302092.173154:0:7937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000562b7be4/0x1ff82925bd398f7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398f73 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302092.173159:0:7937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302092.173196:0:7937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000562b7be4/0x1ff82925bd398f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398f73 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302092.173208:0:7937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000562b7be4/0x1ff82925bd398f7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398f73 expref: 17 pid: 6525 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302092.175423:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018842b4e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7937:1876219121383680:0@lo:104: 00000100:00100000:2.0:1789302092.175734:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302092.175798:0:7937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ad7ae9ec/0x1ff82925bd398e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398e85 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302092.175811:0:7937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ad7ae9ec/0x1ff82925bd398e8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398e85 expref: 17 pid: 6524 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302092.175822:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040b46c72 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7937:1876219121383808:0@lo:104: 00000100:00100000:2.0:1789302092.175843:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7d080ff going to sleep for 11 seconds 00000100:00100000:0.0:1789302092.176064:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789302092.176083:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302092.176148:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121383680 00000100:00100000:0.0:1789302092.176155:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121383680 00000100:00100000:0.0:1789302092.176189:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121383808 00000100:00100000:0.0:1789302092.176192:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121383808 00000100:00100000:0.0:1789302092.176207:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302092.176213:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065417c8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:7937:x1876219121383680:12345-0@lo:104: 00010000:00010000:0.0:1789302092.176236:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176293:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302092.176298:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065417c8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:7937:x1876219121383680:12345-0@lo:104: Request processed in 86us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302092.176304:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302092.176342:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302092.176347:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d8ac0f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:7937:x1876219121383808:12345-0@lo:104: 00010000:00010000:0.0:1789302092.176354:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176399:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789302092.176404:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d8ac0f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:7937:x1876219121383808:12345-0@lo:104: Request processed in 58us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302092.176410:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789302092.176429:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789302092.176434:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176452:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000091ee89c4 already unused, calling callback (0000000091532f94) 10000000:00010000:0.0:1789302092.176457:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176465:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302092.176471:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302092.176476:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789302092.176503:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176510:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302092.176526:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176533:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: 0000000091ee89c4/0x1ff82925bd398f73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f7a expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176567:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302092.176570:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176574:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000002c166bf already unused, calling callback (0000000091532f94) 10000000:00010000:0.0:1789302092.176576:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176593:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302092.176598:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302092.176603:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789302092.176625:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176630:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302092.176635:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176639:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: 0000000002c166bf/0x1ff82925bd398e85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398e8c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.176653:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302092.176654:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302092.176656:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302092.176672:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff0c8c50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121383936:0@lo:103: 00000100:00100000:1.0:1789302092.176903:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018842b4e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7937:1876219121383680:0@lo:104: 00000100:00100000:1.0:1789302092.176912:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040b46c72 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7937:1876219121383808:0@lo:104: 00010000:00010000:1.0:1789302092.176935:0:7937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302092.177193:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302092.177232:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302092.177239:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7250734 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121384064:0@lo:103: 00000100:00100000:0.0:1789302092.177263:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302092.177298:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121383936 00000100:00100000:0.0:1789302092.177303:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121383936 00010000:00010000:0.0:1789302092.177321:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000562b7be4/0x1ff82925bd398f7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398f73 expref: 18 pid: 6525 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302092.177353:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121384064 00000100:00100000:0.0:1789302092.177356:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121384064 00010000:00010000:0.0:1789302092.177366:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ad7ae9ec/0x1ff82925bd398e8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398e85 expref: 19 pid: 6524 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302092.177378:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302092.177395:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f8ba47ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+19:3645:x1876219121383936:12345-0@lo:103: 00010000:00010000:0.0:1789302092.177721:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302092.177727:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000562b7be4/0x1ff82925bd398f7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398f73 expref: 19 pid: 6525 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177737:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000562b7be4/0x1ff82925bd398f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398f73 expref: 19 pid: 6525 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177750:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000562b7be4/0x1ff82925bd398f7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398f73 expref: 19 pid: 6525 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177762:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302092.177794:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f8ba47ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+18:3645:x1876219121383936:12345-0@lo:103: Request processed in 399us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302092.177800:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302092.177823:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302092.177829:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000904dd4f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+17:3645:x1876219121384064:12345-0@lo:103: 00010000:00010000:0.0:1789302092.177837:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302092.177841:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ad7ae9ec/0x1ff82925bd398e8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398e85 expref: 17 pid: 6524 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177850:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ad7ae9ec/0x1ff82925bd398e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398e85 expref: 17 pid: 6524 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177858:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ad7ae9ec/0x1ff82925bd398e8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398e85 expref: 17 pid: 6524 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177868:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177875:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177887:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177892:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177898:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177904:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177909:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bdf97c1c already unused, calling callback (000000006b2f69eb) 00010000:00010000:0.0:1789302092.177912:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177925:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177939:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.177947:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302092.177966:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000904dd4f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+16:3645:x1876219121384064:12345-0@lo:103: Request processed in 139us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302092.177973:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302092.178006:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7250734 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121384064:0@lo:103: 00000100:00100000:0.0:1789302092.178014:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff0c8c50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121383936:0@lo:103: 00010000:00010000:0.0:1789302092.178034:0:7937:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.178042:0:7937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302092.178047:0:7937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bdf97c1c/0x1ff82925bd39900d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302092.178186:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302092.182388:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302093.205429:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302094.228447:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302095.252288:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302095.956682:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302095.956707:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c12765b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121384192:0@lo:41: 00000100:00100000:0.0:1789302095.956774:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302095.956886:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121384192 00000100:00100000:1.0:1789302095.956894:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121384192 00000100:00100000:1.0:1789302095.956946:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789302095.956953:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121384192:12345-0@lo:41: 00000004:00000024:1.0:1789302095.956987:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789302095.957033:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121384192:12345-0@lo:41: Request processed in 81us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302095.957040:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789302095.957083:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c12765b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121384192:0@lo:41: 00000100:00100000:1.0:1789302095.959054:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000742fb4ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121384448:0@lo:400: 00000100:00100000:1.0:1789302095.959129:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302095.959159:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302095.959165:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec2120ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121384576:0@lo:400: 00000100:00100000:1.0:1789302095.959189:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302095.959224:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121384448 00000100:00100000:1.0:1789302095.959238:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121384448 00000100:00100000:1.0:1789302095.959277:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302095.959285:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d3bce1c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121384448:12345-0@lo:400: 00000100:00100000:3.0:1789302095.959336:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098aaccf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121384704:0@lo:400: 00000100:00100000:1.0:1789302095.959336:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d3bce1c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121384448:12345-0@lo:400: Request processed in 53us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302095.959343:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302095.959363:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121384576 00000100:00100000:3.0:1789302095.959364:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302095.959366:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121384576 00000100:00100000:1.0:1789302095.959387:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302095.959388:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789302095.959392:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c12765b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121384320:0@lo:400: 00000100:00100000:1.0:1789302095.959393:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000befb273 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121384576:12345-0@lo:400: 00000100:00100000:1.0:1789302095.959419:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000befb273 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121384576:12345-0@lo:400: Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302095.959425:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302095.959429:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302095.959440:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121384704 00000100:00100000:1.0:1789302095.959443:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121384704 00000100:00100000:3.0:1789302095.959449:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efec9bf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121384832:0@lo:400: 00000100:00100000:1.0:1789302095.959461:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789302095.959466:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000026f32021 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121384704:12345-0@lo:400: 00000100:00100000:3.0:1789302095.959468:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302095.959495:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121384320 00000100:00100000:1.0:1789302095.959496:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000026f32021 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121384704:12345-0@lo:400: Request processed in 30us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302095.959498:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121384320 00000100:00100000:1.0:1789302095.959502:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789302095.959541:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000098aaccf5 x1876219121384704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302095.959544:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789302095.959549:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d952e14b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:3647:x1876219121384320:12345-0@lo:400: 00000100:00100000:1.0:1789302095.959554:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098aaccf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121384704:0@lo:400: 00000100:00100000:1.0:1789302095.959573:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121384832 00000100:00100000:1.0:1789302095.959576:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121384832 00000100:00100000:3.0:1789302095.959581:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d952e14b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:3647:x1876219121384320:12345-0@lo:400: Request processed in 32us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302095.959586:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789302095.959594:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789302095.959598:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007cc475b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121384832:12345-0@lo:400: 00000100:00100000:1.0:1789302095.959633:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007cc475b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121384832:12345-0@lo:400: Request processed in 34us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302095.959639:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789302095.959664:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c12765b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121384320:0@lo:400: 00000100:00100000:1.0:1789302095.959672:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efec9bf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121384832:0@lo:400: 00000100:00100000:0.0:1789302095.961240:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec2120ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121384576:0@lo:400: 00010000:00080000:0.0:1789302095.961259:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000742fb4ed x1876219121384448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302095.961283:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000742fb4ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121384448:0@lo:400: 00010000:00010000:3.0:1789302096.276980:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302096.980343:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7250734 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121384960:0@lo:41: 00000100:00100000:1.0:1789302096.980492:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302096.980791:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121384960 00000100:00100000:3.0:1789302096.980800:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121384960 00000100:00100000:3.0:1789302096.980848:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789302096.980987:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000efec9bf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121384960:12345-0@lo:41: 00000004:00000024:3.0:1789302096.981018:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789302096.981834:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000efec9bf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121384960:12345-0@lo:41: Request processed in 848us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302096.981842:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789302096.982058:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7250734 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121384960:0@lo:41: 00010000:00010000:3.0:1789302097.301009:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302098.324553:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302099.348348:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302100.380835:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789302100.564234:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789302100.564242:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b511e800 from 1 10000000:01000000:0.0:1789302100.564247:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302100.564290:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: 00000000a84f1ac4/0x1ff82925bd399014 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302100.564302:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: 00000000a84f1ac4/0x1ff82925bd399014 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302100.564312:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: 00000000a84f1ac4/0x1ff82925bd399014 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302100.564334:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385088:0@lo:101: 00000100:00100000:0.0:1789302100.564803:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302100.564861:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a83fcf9b going to sleep for 11 seconds 00000100:00100000:2.0:1789302100.565008:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121385088 00000100:00100000:2.0:1789302100.565016:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121385088 00000100:00100000:2.0:1789302100.565067:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789302100.565075:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f9cd212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121385088:12345-0@lo:101: 00010000:00010000:2.0:1789302100.565087:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302100.565101:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d78d7566/0x1ff82925bd39901b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399014 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302100.565505:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d78d7566/0x1ff82925bd39901b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399014 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302100.565517:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d78d7566/0x1ff82925bd39901b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399014 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302100.565526:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d78d7566, rc 0) 00000100:00100000:2.0:1789302100.565578:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f9cd212 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121385088:12345-0@lo:101: Request processed in 504us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302100.565586:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789302100.565783:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385088:0@lo:101: 00010000:00010000:0.0:1789302100.565798:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: 00000000a84f1ac4/0x1ff82925bd399014 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302100.565806:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: 00000000a84f1ac4/0x1ff82925bd399014 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302100.565868:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385216:0@lo:501: 00000100:00100000:0.0:1789302100.565896:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302100.565927:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a83fcf9b going to sleep for 11 seconds 00000100:00100000:2.0:1789302100.566072:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121385216 00000100:00100000:2.0:1789302100.566089:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121385216 00000100:00100000:2.0:1789302100.566143:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789302100.566151:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000903b4b89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121385216:12345-0@lo:501: 00000100:00100000:2.0:1789302100.566555:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000903b4b89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121385216:12345-0@lo:501: Request processed in 405us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302100.566564:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789302100.566646:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385216:0@lo:501: 00000100:00100000:0.0:1789302100.566683:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385344:0@lo:503: 00000100:00100000:0.0:1789302100.566721:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302100.566745:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a83fcf9b going to sleep for 11 seconds 00000100:00100000:2.0:1789302100.566797:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121385344 00000100:00100000:2.0:1789302100.566801:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121385344 00000100:00100000:2.0:1789302100.566896:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789302100.566903:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dbfd7e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121385344:12345-0@lo:503: 00000100:00100000:2.0:1789302100.566979:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dbfd7e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121385344:12345-0@lo:503: Request processed in 76us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302100.566985:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789302100.571763:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096722c76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385344:0@lo:503: 00000100:00100000:3.0:1789302100.572209:0:8356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8356:1876219121385472:0@lo:502: 00000100:00100000:3.0:1789302100.572282:0:8356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302100.572324:0:8356:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1612531 going to sleep for 11 seconds 00000100:00100000:0.0:1789302100.572507:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121385472 00000100:00100000:0.0:1789302100.572514:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121385472 00000100:00100000:0.0:1789302100.572561:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789302100.572570:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f13e6604 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:8356:x1876219121385472:12345-0@lo:502: 00000100:00100000:0.0:1789302100.572696:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f13e6604 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:8356:x1876219121385472:12345-0@lo:502: Request processed in 127us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302100.572704:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789302100.572796:0:8356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014deb788 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8356:1876219121385472:0@lo:502: 00000020:01000000:2.0:1789302100.572818:0:8356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302100.572826:0:8356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302100.572828:0:8356:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789302100.572836:0:8356:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc4b511e800 00000020:00000080:2.0:1789302100.572838:0:8356:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789302100.572876:0:8356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8356:1876219121385600:0@lo:502: 00000100:00100000:2.0:1789302100.572911:0:8356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302100.572940:0:8356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc486159780 going to sleep for 11 seconds 00000100:00100000:0.0:1789302100.572988:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121385600 00000100:00100000:0.0:1789302100.572993:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121385600 00000100:00100000:0.0:1789302100.573022:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789302100.573028:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:8356:x1876219121385600:12345-0@lo:502: 00000100:00100000:0.0:1789302100.573091:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:8356:x1876219121385600:12345-0@lo:502: Request processed in 62us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302100.573097:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789302100.573200:0:8356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8356:1876219121385600:0@lo:502: 00000020:01000000:2.0:1789302100.573218:0:8356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302100.573223:0:8356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302100.573225:0:8356:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789302100.573229:0:8356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789302100.573514:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789302100.573536:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302100.573546:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f400/0x1ff82925bd399014 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302100.573558:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f400/0x1ff82925bd399014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302100.573569:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789302100.573578:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b863d000 from 1 10000000:01000000:0.0:1789302100.573581:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302100.573605:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302100.573614:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302100.573623:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302100.573635:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385728:0@lo:101: 00000100:00100000:0.0:1789302100.573666:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302100.573765:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789302100.573967:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121385728 00000100:00100000:2.0:1789302100.573978:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121385728 00000100:00100000:2.0:1789302100.574044:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789302100.574053:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121385728:12345-0@lo:101: 00010000:00010000:2.0:1789302100.574062:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302100.574073:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd399029 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399022 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302100.574094:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd399029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399022 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302100.574104:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd399029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399022 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302100.574143:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982800, rc 0) 00000100:00100000:2.0:1789302100.574187:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121385728:12345-0@lo:101: Request processed in 136us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302100.574194:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789302100.574384:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385728:0@lo:101: 00010000:00010000:0.0:1789302100.574463:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302100.574474:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302100.574533:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385856:0@lo:501: 00000100:00100000:0.0:1789302100.574559:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302100.574614:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789302100.574650:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121385856 00000100:00100000:2.0:1789302100.574654:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121385856 00000100:00100000:2.0:1789302100.574717:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789302100.574725:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121385856:12345-0@lo:501: 00000100:00100000:2.0:1789302100.574823:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121385856:12345-0@lo:501: Request processed in 98us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302100.574830:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789302100.574885:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385856:0@lo:501: 00000100:00100000:0.0:1789302100.574909:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385984:0@lo:503: 00000100:00100000:0.0:1789302100.574944:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302100.575053:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6840 going to sleep for 11 seconds 00000100:00100000:3.0:1789302100.575150:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121385984 00000100:00100000:3.0:1789302100.575155:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121385984 00000100:00100000:3.0:1789302100.575185:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789302100.575192:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121385984:12345-0@lo:503: 00000100:00100000:3.0:1789302100.575268:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121385984:12345-0@lo:503: Request processed in 76us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302100.575274:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789302100.575522:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121385984:0@lo:503: 00000100:00100000:3.0:1789302100.575845:0:8357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8357:1876219121386112:0@lo:502: 00000100:00100000:3.0:1789302100.575883:0:8357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302100.575948:0:8357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b5e98600 going to sleep for 11 seconds 00000100:00100000:1.0:1789302100.575983:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121386112 00000100:00100000:1.0:1789302100.575988:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121386112 00000100:00100000:0.0:1789302100.576031:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789302100.576040:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:8357:x1876219121386112:12345-0@lo:502: 00000100:00100000:0.0:1789302100.576146:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:8357:x1876219121386112:12345-0@lo:502: Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302100.576154:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789302100.576258:0:8357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8357:1876219121386112:0@lo:502: 00000020:01000000:3.0:1789302100.576278:0:8357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302100.576286:0:8357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302100.576288:0:8357:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789302100.576294:0:8357:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc4b863d000 00000020:00000080:3.0:1789302100.576296:0:8357:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789302100.576316:0:8357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8357:1876219121386240:0@lo:502: 00000100:00100000:3.0:1789302100.576349:0:8357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302100.576370:0:8357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48831e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789302100.576511:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121386240 00000100:00100000:0.0:1789302100.576515:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121386240 00000100:00100000:0.0:1789302100.576531:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302100.576536:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:8357:x1876219121386240:12345-0@lo:502: 00000100:00100000:0.0:1789302100.576594:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:8357:x1876219121386240:12345-0@lo:502: Request processed in 57us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302100.576600:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789302100.576744:0:8357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8357:1876219121386240:0@lo:502: 00000020:01000000:3.0:1789302100.576761:0:8357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302100.576765:0:8357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302100.576767:0:8357:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789302100.576775:0:8357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789302100.577012:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789302100.577033:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302100.577042:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302100.577054:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302101.080581:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121386368:0@lo:400: 00000100:00100000:3.0:1789302101.080691:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302101.080775:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121386880:0@lo:400: 00000100:00100000:3.0:1789302101.080808:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302101.080844:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302101.080852:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121386752:0@lo:400: 00000100:00100000:3.0:1789302101.080880:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302101.080922:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121386752 00000100:00100000:3.0:1789302101.080933:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121386752 00000100:00100000:3.0:1789302101.080995:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789302101.081006:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121386752:12345-0@lo:400: 00000100:00100000:3.0:1789302101.081072:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121386752:12345-0@lo:400: Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302101.081080:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789302101.081144:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc485d53b80 x1876219121386752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302101.081161:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121386752:0@lo:400: 00000100:00100000:1.0:1789302101.081491:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121386496:0@lo:400: 00000100:00100000:1.0:1789302101.081532:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302101.081570:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302101.081578:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121386624:0@lo:400: 00000100:00100000:1.0:1789302101.081604:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302101.081639:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121386880 00000100:00100000:1.0:1789302101.081644:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121386880 00000100:00100000:1.0:1789302101.081679:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121386624 00000100:00100000:1.0:1789302101.081682:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121386624 00000100:00100000:1.0:1789302101.081696:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302101.081703:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121386880:12345-0@lo:400: 00000100:00100000:1.0:1789302101.081749:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121386880:12345-0@lo:400: Request processed in 46us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302101.081756:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302101.081770:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302101.081777:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121386624:12345-0@lo:400: 00000100:00100000:1.0:1789302101.081823:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121386624:12345-0@lo:400: Request processed in 46us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302101.081829:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302101.081847:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121386496 00000100:00100000:1.0:1789302101.081850:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121386496 00000100:00100000:1.0:1789302101.081872:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302101.081879:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121386496:12345-0@lo:400: 00000100:00100000:1.0:1789302101.081909:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121386496:12345-0@lo:400: Request processed in 31us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302101.081916:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302101.081952:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121386624:0@lo:400: 00010000:00080000:1.0:1789302101.081964:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc485d52300 x1876219121386496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302101.081973:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121386496:0@lo:400: 00000100:00100000:1.0:1789302101.082002:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121386880:0@lo:400: 00000100:00100000:2.0:1789302101.085839:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121386368 00000100:00100000:2.0:1789302101.085861:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121386368 00000100:00100000:2.0:1789302101.085967:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789302101.085981:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:3646:x1876219121386368:12345-0@lo:400: 00000100:00100000:2.0:1789302101.086106:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:3646:x1876219121386368:12345-0@lo:400: Request processed in 129us (5415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302101.086156:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789302101.086244:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302101.086263:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121387008:0@lo:41: 00000100:00100000:2.0:1789302101.086304:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302101.086419:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121387008 00000100:00100000:1.0:1789302101.086424:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121387008 00000100:00100000:1.0:1789302101.086464:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789302101.086473:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121387008:12345-0@lo:41: 00000004:00000024:1.0:1789302101.086517:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789302101.086563:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121387008:12345-0@lo:41: Request processed in 92us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302101.086570:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789302101.086618:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121387008:0@lo:41: 00000100:00100000:1.0:1789302101.086654:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121386368:0@lo:400: 00010000:00010000:3.0:1789302101.397300:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789302102.092907:0:8438:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789302102.092913:0:8438:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789302102.092914:0:8438:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789302102.093038:0:8438:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cc4adc31000 00000020:01000004:3.0:1789302102.093059:0:8438:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789302102.093074:0:8438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789302102.093091:0:8438:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cc485df0000) 00000020:00000080:3.0:1789302102.093144:0:8438:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000100:00100000:1.0:1789302102.111502:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121387136:0@lo:41: 00000100:00100000:1.0:1789302102.111597:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302102.111920:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121387136 00000100:00100000:3.0:1789302102.111944:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121387136 00000100:00100000:3.0:1789302102.112003:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789302102.112014:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121387136:12345-0@lo:41: 00000004:00000024:3.0:1789302102.112058:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789302102.112537:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121387136:12345-0@lo:41: Request processed in 521us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302102.112546:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789302102.114578:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121387136:0@lo:41: 00100000:10000000:3.0:1789302102.145423:0:8438:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789302102.146071:0:8438:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1789302102.171765:0:8438:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789302102.172052:0:8438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789302102.172070:0:8438:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789302102.172086:0:8438:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1ff82925bd399037 00000020:01000004:2.0:1789302102.172095:0:8438:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789302102.172144:0:8438:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.109@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789302102.172148:0:8438:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789302102.172156:0:8438:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789302102.172163:0:8438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789302102.172187:0:8438:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cc4bd978000) 00000020:00000080:2.0:1789302102.172203:0:8438:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1789302102.174145:0:8438:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789302102.174358:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789302102.174366:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789302102.181579:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789302102.181669:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789302102.183147:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789302102.183159:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789302102.190971:0:8438:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789302102.191360:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789302102.191369:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789302102.193899:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789302102.193919:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789302102.213355:0:8438:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789302102.213689:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789302102.213697:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789302102.219896:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789302102.219920:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789302102.232353:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789302102.233429:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789302102.237693:0:8438:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302102.238076:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789302102.238083:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789302102.240919:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789302102.240945:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789302102.343280:0:8438:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789302102.343668:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789302102.343683:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789302102.346310:0:8438:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789302102.346332:0:8438:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789302102.347532:0:8438:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789302102.347569:0:8438:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789302102.347577:0:8438:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789302102.366996:0:8438:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.109@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789302102.367033:0:8438:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.109@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789302102.367038:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789302102.367039:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789302102.367041:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302102.367042:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302102.367043:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302102.367044:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302102.367045:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302102.367047:0:8438:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789302102.367052:0:8438:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789302102.367053:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302102.367054:0:8438:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789302102.367058:0:8438:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789302102.367061:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789302102.367062:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789302102.367063:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302102.367064:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302102.367065:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302102.367066:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302102.367067:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302102.367068:0:8438:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789302102.367069:0:8438:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789302102.367070:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302102.367071:0:8438:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789302102.367102:0:8438:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789302102.367205:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121387264:0@lo:253: 00000100:00100000:3.0:1789302102.367281:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302102.367340:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc381084c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302102.367788:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121387264 00000100:00100000:1.0:1789302102.367797:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121387264 00000100:00100000:1.0:1789302102.367850:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789302102.367859:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+18:8438:x1876219121387264:12345-0@lo:253: 20000000:01000000:1.0:1789302102.367897:0:6523:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789302102.367901:0:6523:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789302102.367906:0:6523:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789302102.367908:0:6523:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789302102.368089:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302102.368230:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789302102.368245:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789302102.368261:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789302102.368265:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789302102.368276:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789302102.368287:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789302102.368353:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789302102.368365:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.109@tcp 20000000:01000000:1.0:1789302102.368367:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.109@tcp (null) (null) (null) 00000040:00080000:1.0:1789302102.368378:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789302102.368383:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789302102.368394:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789302102.368399:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.109@tcp (null) (null) 00000040:00080000:1.0:1789302102.368409:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789302102.368414:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789302102.368440:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789302102.368464:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789302102.368546:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1789302102.368556:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.109@tcp 20000000:01000000:1.0:1789302102.368558:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.109@tcp (null) (null) (null) 00000040:00080000:1.0:1789302102.368569:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1789302102.368574:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789302102.368584:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1789302102.368589:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.109@tcp (null) (null) 00000040:00080000:1.0:1789302102.368600:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1789302102.368605:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789302102.368616:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1789302102.368629:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1789302102.368998:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1789302102.369007:0:6523:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.109@tcp 20000000:01000000:1.0:1789302102.369009:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.109@tcp (null) (null) (null) 00000040:00080000:1.0:1789302102.369020:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1789302102.369024:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789302102.369035:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1789302102.369038:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.109@tcp (null) (null) 00000040:00080000:1.0:1789302102.369048:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1789302102.369053:0:6523:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789302102.369062:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1789302102.369074:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1789302102.369087:0:6523:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789302102.369089:0:6523:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789302102.369093:0:6523:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789302102.369181:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789302102.369183:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789302102.370812:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789302102.371068:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789302102.371354:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789302102.371374:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789302102.371387:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789302102.371390:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789302102.371718:0:8458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1789302102.371738:0:8458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1789302102.371747:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1789302102.371879:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1789302102.371908:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1789302102.371922:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1789302102.371933:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789302102.371935:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789302102.372489:0:8459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1789302102.372516:0:8459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1789302102.372532:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789302102.372704:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1789302102.372724:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1789302102.372738:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1789302102.372747:0:6523:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789302102.372749:0:6523:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789302102.373012:0:8460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1789302102.373033:0:8460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1789302102.373045:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789302102.373392:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789302102.373412:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789302102.373426:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1789302102.373443:0:6523:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789302102.373465:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.373498:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc480031a00/0x1ff82925bd398f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398f0a expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.373506:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc480030400/0x1ff82925bd398f88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398f81 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.373513:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b538e800/0x1ff82925bd398fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398fb9 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.373519:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48166ec00/0x1ff82925bd398fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398fd5 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.373547:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b538f600/0x1ff82925bd399006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398fff expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.373554:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.373592:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b538f600/0x1ff82925bd399006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398fff expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.373604:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4b538f600/0x1ff82925bd399006 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398fff expref: 18 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302102.373616:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121387392:0@lo:104: 00000100:00100000:0.0:1789302102.373668:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302102.373736:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48166ec00/0x1ff82925bd398fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398fd5 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.373742:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc48166ec00/0x1ff82925bd398fdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398fd5 expref: 18 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302102.373748:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121387520:0@lo:104: 00000100:00100000:0.0:1789302102.373762:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302102.373861:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b538e800/0x1ff82925bd398fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398fb9 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.373866:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4b538e800/0x1ff82925bd398fc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398fb9 expref: 18 pid: 6524 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302102.373872:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121387648:0@lo:104: 00000100:00100000:0.0:1789302102.373896:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302102.373918:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121387392 00000100:00100000:2.0:1789302102.373925:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121387392 00000100:00100000:1.0:1789302102.374012:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121387520 00000100:00100000:1.0:1789302102.374017:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121387520 00000100:00100000:1.0:1789302102.374035:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121387648 00000100:00100000:1.0:1789302102.374038:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121387648 00010000:00010000:0.0:1789302102.374042:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc480030400/0x1ff82925bd398f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398f81 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374050:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789302102.374051:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc480030400/0x1ff82925bd398f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398f81 expref: 18 pid: 6525 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374057:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:6523:x1876219121387392:12345-0@lo:104: 00000100:00100000:0.0:1789302102.374060:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121387776:0@lo:104: 00010000:00010000:1.0:1789302102.374069:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd398fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302102.374266:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302102.374289:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789302102.374295:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:6523:x1876219121387392:12345-0@lo:104: Request processed in 238us (627us total) trans 0 rc 0/0 00010000:00010000:0.0:1789302102.374300:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc480031a00/0x1ff82925bd398f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398f0a expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374302:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789302102.374308:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc480031a00/0x1ff82925bd398f11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398f0a expref: 18 pid: 6525 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302102.374316:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121387904:0@lo:104: 00000100:00100000:1.0:1789302102.374317:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121387776 00000100:00100000:1.0:1789302102.374320:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121387776 00000100:00100000:1.0:1789302102.374334:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302102.374339:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:6523:x1876219121387520:12345-0@lo:104: 00000100:00100000:0.0:1789302102.374339:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302102.374347:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd398fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302102.374350:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc483b37e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302102.374369:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121387392:0@lo:104: 00000100:00100000:0.0:1789302102.374377:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121387520:0@lo:104: 00010000:00010000:1.0:1789302102.374378:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789302102.374382:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:6523:x1876219121387520:12345-0@lo:104: Request processed in 44us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.374387:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302102.374398:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121387904 00000100:00100000:1.0:1789302102.374401:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121387904 00000100:00100000:1.0:1789302102.374424:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789302102.374428:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789302102.374429:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:6523:x1876219121387648:12345-0@lo:104: 00010000:00010000:3.0:1789302102.374434:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd398fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.374436:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd398fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374442:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538fa00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302102.374446:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd398fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374454:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd398fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302102.374461:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd398fff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302102.374467:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302102.374467:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789302102.374487:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:6523:x1876219121387648:12345-0@lo:104: Request processed in 43us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.374493:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789302102.374503:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd398fff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374505:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302102.374511:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:6523:x1876219121387776:12345-0@lo:104: 00010000:00010000:3.0:1789302102.374515:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302102.374517:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc480030200/0x1ff82925bd398f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374532:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd398fff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374540:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd398fff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399006 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.374540:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789302102.374544:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:6523:x1876219121387776:12345-0@lo:104: Request processed in 34us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.374549:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789302102.374552:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789302102.374555:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd398fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374559:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789302102.374561:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166fa00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302102.374564:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd398fd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374564:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:6523:x1876219121387904:12345-0@lo:104: 00010000:00010000:3.0:1789302102.374572:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd398fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.374572:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd398f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302102.374579:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd398fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302102.374585:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302102.374593:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789302102.374598:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:6523:x1876219121387904:12345-0@lo:104: Request processed in 34us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.374603:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789302102.374608:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd398fd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374613:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302102.374616:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789302102.374619:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd398fd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374625:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd398fd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fdc expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374638:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789302102.374639:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121388032:0@lo:103: 00010000:00010000:3.0:1789302102.374641:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc480030200/0x1ff82925bd398f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374646:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480030200 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302102.374649:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc480030200/0x1ff82925bd398f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374656:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc480030200/0x1ff82925bd398f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302102.374662:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc480030200/0x1ff82925bd398f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374665:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789302102.374668:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302102.374680:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc480030200/0x1ff82925bd398f81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374685:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789302102.374686:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789302102.374690:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121388160:0@lo:103: 00010000:00010000:3.0:1789302102.374698:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc480030200/0x1ff82925bd398f81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374706:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc480030200/0x1ff82925bd398f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f88 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374707:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789302102.374716:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302102.374718:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd398f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374730:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121388032 00000100:00100000:1.0:1789302102.374733:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121388032 00010000:00010000:3.0:1789302102.374734:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166fe00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302102.374737:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd398f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374743:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd398f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.374747:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b538f600/0x1ff82925bd399006 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398fff expref: 19 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302102.374749:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd398f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302102.374755:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789302102.374765:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121388160 00010000:00010000:3.0:1789302102.374767:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd398f0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374768:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121388160 00010000:00010000:3.0:1789302102.374773:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302102.374776:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48166ec00/0x1ff82925bd398fdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398fd5 expref: 20 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374778:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd398f0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.374785:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd398f0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398f11 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374788:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789302102.374793:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302102.374793:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5283100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+20:3645:x1876219121388032:12345-0@lo:103: 00010000:00010000:3.0:1789302102.374795:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302102.374797:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302102.374802:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302102.374807:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b538f600/0x1ff82925bd399006 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398fff expref: 20 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.374816:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b538f600/0x1ff82925bd399006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398fff expref: 20 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.374829:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538f600/0x1ff82925bd399006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398fff expref: 20 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.374839:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302102.374868:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5283100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+19:3645:x1876219121388032:12345-0@lo:103: Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302102.374879:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121388032:0@lo:103: 00000100:00100000:1.0:1789302102.374882:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789302102.374894:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302102.374899:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+18:3645:x1876219121388160:12345-0@lo:103: 00010000:00010000:1.0:1789302102.374907:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302102.374911:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48166ec00/0x1ff82925bd398fdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398fd5 expref: 18 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.374920:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48166ec00/0x1ff82925bd398fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398fd5 expref: 18 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.374931:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166ec00/0x1ff82925bd398fdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398fd5 expref: 18 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.374939:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302102.374950:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121387648:0@lo:104: 00000100:00100000:0.0:1789302102.374958:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121387776:0@lo:104: 00000100:00100000:0.0:1789302102.374965:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6523:1876219121387904:0@lo:104: 00000100:00100000:1.0:1789302102.374969:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+17:3645:x1876219121388160:12345-0@lo:103: Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.374974:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789302102.374985:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.374992:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121388288:0@lo:103: 00000100:00100000:1.0:1789302102.375013:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302102.375033:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121388160:0@lo:103: 00000100:00100000:1.0:1789302102.375036:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302102.375040:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121388416:0@lo:103: 00000100:00100000:1.0:1789302102.375059:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302102.375070:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121388288 00000100:00100000:1.0:1789302102.375096:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121388416 00000100:00100000:1.0:1789302102.375100:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121388416 00010000:00010000:1.0:1789302102.375136:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc480031a00/0x1ff82925bd398f11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398f0a expref: 17 pid: 6525 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.375150:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302102.375164:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+17:3647:x1876219121388416:12345-0@lo:103: 00010000:00010000:1.0:1789302102.375172:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302102.375176:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc480031a00/0x1ff82925bd398f11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398f0a expref: 17 pid: 6525 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.375183:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc480031a00/0x1ff82925bd398f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398f0a expref: 17 pid: 6525 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.375193:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc480031a00/0x1ff82925bd398f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398f0a expref: 17 pid: 6525 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.375201:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302102.375230:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+16:3647:x1876219121388416:12345-0@lo:103: Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.375236:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789302102.375296:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121388416:0@lo:103: 00000100:00100000:0.0:1789302102.375362:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121388288 00010000:00010000:0.0:1789302102.375384:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc480030400/0x1ff82925bd398f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398f81 expref: 16 pid: 6525 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302102.375411:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302102.375418:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+16:3647:x1876219121388288:12345-0@lo:103: 00010000:00010000:0.0:1789302102.375426:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302102.375429:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc480030400/0x1ff82925bd398f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398f81 expref: 16 pid: 6525 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.375437:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc480030400/0x1ff82925bd398f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398f81 expref: 16 pid: 6525 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.375447:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc480030400/0x1ff82925bd398f88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398f81 expref: 16 pid: 6525 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.375456:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302102.375502:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+15:3647:x1876219121388288:12345-0@lo:103: Request processed in 84us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.375508:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302102.375532:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121388288:0@lo:103: 00010000:00010000:2.0:1789302102.375686:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302102.375689:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302102.375691:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302102.375719:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd398fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.375727:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983800 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302102.375731:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd398fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.375738:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd398fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302102.375745:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd398fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302102.375750:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302102.375784:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd398fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.375796:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789302102.375835:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121388544:0@lo:103: 00000100:00100000:2.0:1789302102.375866:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302102.375936:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121388544 00000100:00100000:3.0:1789302102.375941:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121388544 00010000:00010000:3.0:1789302102.375958:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b538e800/0x1ff82925bd398fc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398fb9 expref: 15 pid: 6524 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302102.375975:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789302102.375988:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc499219c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+15:3645:x1876219121388544:12345-0@lo:103: 00010000:00010000:3.0:1789302102.375997:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302102.376001:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b538e800/0x1ff82925bd398fc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398fb9 expref: 15 pid: 6524 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376009:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b538e800/0x1ff82925bd398fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398fb9 expref: 15 pid: 6524 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376018:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538e800/0x1ff82925bd398fc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398fb9 expref: 15 pid: 6524 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376029:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376036:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376049:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376057:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376063:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376069:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376085:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302102.376090:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376104:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376138:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.376150:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302102.376246:0:6523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.376255:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.376262:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd399045 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789302102.376275:0:6523:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1789302102.376416:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd398fb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.376424:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd398fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fc0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.376436:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302102.376437:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302102.376439:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302102.378200:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc499219c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+14:3645:x1876219121388544:12345-0@lo:103: Request processed in 2205us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302102.378200:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121388544:0@lo:103: 00000100:00100000:0.0:1789302102.378204:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121387264:12345-0@lo:253: Request processed in 10346us (10922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.378218:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789302102.378414:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302102.378506:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121387264:0@lo:253: 10000000:01000000:1.0:1789302102.378519:0:8438:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789302102.378521:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789302102.378522:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789302102.378523:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302102.378524:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789302102.378526:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302102.378526:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302102.378527:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789302102.378528:0:8438:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789302102.378529:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302102.378530:0:8438:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789302102.378544:0:8438:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cc4adc31000 from lustre-OST0000 10000000:01000000:1.0:1789302102.378569:0:8438:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789302102.378571:0:8438:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789302102.378577:0:8438:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cc4ac2ab380 local copy 10000000:01000000:1.0:1789302102.378580:0:8438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789302102.378606:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.378614:0:8438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.378628:0:8438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.378640:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121388672:0@lo:101: 00000100:00100000:1.0:1789302102.378666:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302102.378720:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302102.378748:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121388672 00000100:00100000:0.0:1789302102.378753:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121388672 00000100:00100000:0.0:1789302102.378785:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789302102.378927:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+13:8438:x1876219121388672:12345-0@lo:101: 00010000:00010000:0.0:1789302102.378937:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302102.378947:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538e000/0x1ff82925bd399053 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39904c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.378964:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538e000/0x1ff82925bd399053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39904c expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.378971:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538e000/0x1ff82925bd399053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39904c expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.378977:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538e000, rc 0) 00000100:00100000:0.0:1789302102.379032:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121388672:12345-0@lo:101: Request processed in 108us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.379036:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789302102.379328:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121388672:0@lo:101: 00010000:00010000:1.0:1789302102.379344:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.379353:0:8438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.379442:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121388800:0@lo:501: 00000100:00100000:1.0:1789302102.379469:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302102.379536:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302102.379568:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121388800 00000100:00100000:0.0:1789302102.379572:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121388800 00000100:00100000:0.0:1789302102.379627:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789302102.379635:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121388800:12345-0@lo:501: 00000100:00100000:0.0:1789302102.379697:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121388800:12345-0@lo:501: Request processed in 63us (227us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302102.379704:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789302102.379750:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121388800:0@lo:501: 10000000:01000000:1.0:1789302102.379761:0:8438:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789302102.379775:0:8438:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789302102.379780:0:8438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.379788:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.379794:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.379823:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789302102.379844:0:8438:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cc4adc31000 10000000:01000000:1.0:1789302102.379847:0:8438:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789302102.379852:0:8438:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789302102.379855:0:8438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789302102.379858:0:8438:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789302102.379861:0:8438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789302102.379874:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.379881:0:8438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.379888:0:8438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.379898:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121388928:0@lo:101: 00000100:00100000:1.0:1789302102.379920:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789302102.379977:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302102.379983:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.379988:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178c00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302102.379991:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.379997:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302102.380001:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302102.380005:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302102.380020:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.380023:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302102.380052:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.380060:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd39904c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1ff82925bd399053 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.380071:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302102.380073:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302102.380075:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302102.380375:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789302102.380399:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121388928 00000100:00100000:2.0:1789302102.380402:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121388928 00000100:00100000:2.0:1789302102.380422:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789302102.380427:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121388928:12345-0@lo:101: 00010000:00010000:2.0:1789302102.380432:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302102.380440:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd399061 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39905a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302102.380454:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd399061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39905a expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302102.380460:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd399061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39905a expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302102.380465:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982e00, rc 0) 00000100:00100000:0.0:1789302102.380527:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121389056:0@lo:103: 00000100:00100000:2.0:1789302102.380553:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:8438:x1876219121388928:12345-0@lo:101: Request processed in 125us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.380559:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302102.380560:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789302102.380617:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121389056 00000100:00100000:3.0:1789302102.380621:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121389056 00000100:00100000:3.0:1789302102.380649:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302102.380656:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+15:3646:x1876219121389056:12345-0@lo:103: 00010000:00010000:3.0:1789302102.380665:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302102.380676:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538e000/0x1ff82925bd399053 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd39904c expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.380685:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302102.380718:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121388928:0@lo:101: 00000100:00100000:3.0:1789302102.380725:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+14:3646:x1876219121389056:12345-0@lo:103: Request processed in 70us (165us total) trans 0 rc 0/0 00010000:00010000:1.0:1789302102.380729:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302102.380731:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789302102.380737:0:8438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302102.380788:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121389056:0@lo:103: 00000100:00100000:1.0:1789302102.380801:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389184:0@lo:501: 00000100:00100000:1.0:1789302102.380834:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302102.380850:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789302102.380863:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121389184 00000100:00100000:2.0:1789302102.380872:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121389184 00000100:00100000:2.0:1789302102.380899:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789302102.380904:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121389184:12345-0@lo:501: 00000100:00100000:2.0:1789302102.380988:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121389184:12345-0@lo:501: Request processed in 83us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302102.380995:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789302102.381009:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389184:0@lo:501: 00000100:00100000:1.0:1789302102.381034:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389312:0@lo:503: 00000100:00100000:1.0:1789302102.381082:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302102.381096:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302102.381107:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121389312 00000100:00100000:0.0:1789302102.381133:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121389312 00000100:00100000:2.0:1789302102.381264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789302102.381270:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121389312:12345-0@lo:503: 00000100:00100000:2.0:1789302102.381338:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121389312:12345-0@lo:503: Request processed in 67us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302102.381346:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789302102.381363:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389312:0@lo:503: 00000040:00080000:1.0:1789302102.381583:0:8438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789302102.381626:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389440:0@lo:502: 00000100:00100000:1.0:1789302102.381650:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302102.381673:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302102.381682:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121389440 00000100:00100000:0.0:1789302102.381687:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121389440 00000100:00100000:0.0:1789302102.381715:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789302102.381721:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121389440:12345-0@lo:502: 00000100:00100000:0.0:1789302102.381795:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121389440:12345-0@lo:502: Request processed in 69us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.381802:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789302102.381846:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389440:0@lo:502: 00000040:00080000:1.0:1789302102.381985:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789302102.382003:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789302102.382010:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789302102.382017:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789302102.382024:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789302102.382031:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789302102.382045:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389568:0@lo:502: 00000100:00100000:1.0:1789302102.382069:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302102.382094:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302102.382099:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121389568 00000100:00100000:0.0:1789302102.382103:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121389568 00000100:00100000:0.0:1789302102.382300:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789302102.382308:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121389568:12345-0@lo:502: 00000100:00100000:0.0:1789302102.382370:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121389568:12345-0@lo:502: Request processed in 63us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.382377:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789302102.382390:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5282d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389568:0@lo:502: 00000040:00080000:1.0:1789302102.382422:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789302102.382429:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789302102.382915:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789302102.382923:0:8462:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789302102.382935:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302102.382937:0:8462:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789302102.382943:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789302102.382968:0:8462:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cc381fc4d40) 00000020:00000080:1.0:1789302102.382987:0:8462:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789302102.382994:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789302102.383164:0:8462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc4adc31000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789302102.383174:0:8462:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789302102.383181:0:8462:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1ff82925bd39906f 00010000:00010000:1.0:1789302102.386329:0:8462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1789302102.387294:0:8462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789302102.389818:0:8462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789302102.390190:0:8462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789302102.394313:0:8462:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789302102.394579:0:8462:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789302102.398311:0:8462:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789302102.400076:0:8462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789302102.400089:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302102.400096:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302102.400098:0:8462:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789302102.400102:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302102.400108:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302102.400287:0:8462:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789302102.400295:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789302102.400298:0:8462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789302102.400325:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302102.400335:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302102.400337:0:8462:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789302102.400341:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789302102.400500:0:8438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789302102.400529:0:8438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789302102.400587:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.400601:0:8438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302102.400611:0:8438:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4adc31000 from 1 10000000:01000000:3.0:1789302102.400621:0:8438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789302102.400658:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.400667:0:8438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.400678:0:8438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302102.400701:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389696:0@lo:101: 00000100:00100000:3.0:1789302102.400772:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302102.400857:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3810846c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302102.400936:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121389696 00000100:00100000:1.0:1789302102.400943:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121389696 00000100:00100000:1.0:1789302102.401028:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789302102.401038:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+14:8438:x1876219121389696:12345-0@lo:101: 00010000:00010000:1.0:1789302102.401051:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302102.401065:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4c2179200/0x1ff82925bd39907d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399076 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.401087:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2179200/0x1ff82925bd39907d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399076 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.401098:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4c2179200/0x1ff82925bd39907d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399076 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.401106:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2179200, rc 0) 00000100:00100000:1.0:1789302102.401199:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:8438:x1876219121389696:12345-0@lo:101: Request processed in 162us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.401214:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789302102.401299:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389696:0@lo:101: 00010000:00010000:0.0:1789302102.401313:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.401323:0:8438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302102.401413:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389824:0@lo:501: 00000100:00100000:0.0:1789302102.401443:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302102.401689:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc180 going to sleep for 11 seconds 00000100:00100000:3.0:1789302102.404873:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121389824 00000100:00100000:3.0:1789302102.404890:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121389824 00000100:00100000:1.0:1789302102.404981:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789302102.405000:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:8438:x1876219121389824:12345-0@lo:501: 00000100:00100000:1.0:1789302102.405692:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:8438:x1876219121389824:12345-0@lo:501: Request processed in 695us (4245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.405703:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789302102.405720:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389824:0@lo:501: 00000100:00100000:3.0:1789302102.405774:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389952:0@lo:503: 00000100:00100000:3.0:1789302102.405840:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302102.405879:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc381084240 going to sleep for 11 seconds 00000100:00100000:2.0:1789302102.406020:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121389952 00000100:00100000:2.0:1789302102.406026:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121389952 00000100:00100000:2.0:1789302102.406063:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789302102.406071:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:8438:x1876219121389952:12345-0@lo:503: 00000100:00100000:2.0:1789302102.406183:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:8438:x1876219121389952:12345-0@lo:503: Request processed in 113us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302102.406191:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789302102.406233:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121389952:0@lo:503: 00000040:00080000:2.0:1789302102.406646:0:8438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789302102.406735:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390080:0@lo:502: 00000100:00100000:2.0:1789302102.406782:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302102.406814:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7ef6540 going to sleep for 11 seconds 00000100:00100000:1.0:1789302102.406828:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121390080 00000100:00100000:1.0:1789302102.406835:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121390080 00000100:00100000:1.0:1789302102.406874:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789302102.406885:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:8438:x1876219121390080:12345-0@lo:502: 00000100:00100000:1.0:1789302102.406997:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:8438:x1876219121390080:12345-0@lo:502: Request processed in 113us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.407006:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789302102.407023:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390080:0@lo:502: 00000040:00080000:2.0:1789302102.407231:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789302102.407261:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789302102.407296:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390208:0@lo:502: 00000100:00100000:2.0:1789302102.407332:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302102.407362:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121390208 00000100:00100000:2.0:1789302102.407366:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7ef6540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302102.407368:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121390208 00000100:00100000:0.0:1789302102.407401:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789302102.407411:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:8438:x1876219121390208:12345-0@lo:502: 00000100:00100000:0.0:1789302102.407505:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:8438:x1876219121390208:12345-0@lo:502: Request processed in 97us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.407514:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789302102.407610:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390208:0@lo:502: 00000040:00080000:2.0:1789302102.407657:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789302102.407668:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789302102.408635:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302102.408646:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302102.408649:0:8466:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789302102.408654:0:8466:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc4adc31000 00000020:00000080:0.0:1789302102.408657:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302102.408669:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302102.408672:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302102.408673:0:8466:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789302102.408676:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789302102.409196:0:8438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789302102.409332:0:8438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302102.409352:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302102.409365:0:8438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302102.409412:0:8438:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789302102.409415:0:8438:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cc4adc31000 10000000:01000000:2.0:1789302102.409418:0:8438:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cc4adc31000 10000000:01000000:2.0:1789302102.409422:0:8438:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789302102.409427:0:8438:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4adc31000 from 1 10000000:01000000:2.0:1789302102.409429:0:8438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789302102.409853:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302102.409863:0:8438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302102.409875:0:8438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302102.409897:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390336:0@lo:101: 00000100:00100000:2.0:1789302102.409963:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302102.410040:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7ef6300 going to sleep for 11 seconds 00000100:00100000:1.0:1789302102.411057:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121390336 00000100:00100000:1.0:1789302102.411066:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121390336 00000100:00100000:1.0:1789302102.411390:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789302102.411402:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:8438:x1876219121390336:12345-0@lo:101: 00010000:00010000:1.0:1789302102.411418:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302102.411433:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39908b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399084 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.411457:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39908b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399084 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.411469:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39908b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399084 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.411565:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178800, rc 0) 00000100:00100000:1.0:1789302102.411629:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:8438:x1876219121390336:12345-0@lo:101: Request processed in 229us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.411637:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789302102.411657:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390336:0@lo:101: 00010000:00010000:3.0:1789302102.411673:0:8438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.411681:0:8438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302102.411781:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390464:0@lo:501: 00000100:00100000:3.0:1789302102.411830:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302102.411873:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3810849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302102.411884:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121390464 00000100:00100000:0.0:1789302102.411897:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121390464 00000100:00100000:0.0:1789302102.411932:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789302102.411939:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:8438:x1876219121390464:12345-0@lo:501: 00000100:00100000:0.0:1789302102.412045:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:8438:x1876219121390464:12345-0@lo:501: Request processed in 106us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.412052:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789302102.412196:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390464:0@lo:501: 00000100:00100000:3.0:1789302102.412578:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390592:0@lo:503: 00000100:00100000:3.0:1789302102.412627:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302102.412658:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3810849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302102.412713:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121390592 00000100:00100000:0.0:1789302102.412718:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121390592 00000100:00100000:0.0:1789302102.412752:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789302102.412760:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:8438:x1876219121390592:12345-0@lo:503: 00000100:00100000:0.0:1789302102.412845:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:8438:x1876219121390592:12345-0@lo:503: Request processed in 86us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.412851:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789302102.412950:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390592:0@lo:503: 00000040:00080000:3.0:1789302102.413241:0:8438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789302102.413382:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390720:0@lo:502: 00000100:00100000:3.0:1789302102.413418:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302102.413444:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3810849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302102.413587:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121390720 00000100:00100000:0.0:1789302102.413592:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121390720 00000100:00100000:0.0:1789302102.413624:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789302102.413631:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:8438:x1876219121390720:12345-0@lo:502: 00000100:00100000:0.0:1789302102.413704:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:8438:x1876219121390720:12345-0@lo:502: Request processed in 73us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.413712:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789302102.413812:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390720:0@lo:502: 00000040:00080000:3.0:1789302102.413978:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789302102.414003:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789302102.414019:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789302102.414033:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789302102.414046:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789302102.414060:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789302102.414073:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789302102.414086:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789302102.414100:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789302102.414363:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789302102.414385:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789302102.414399:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789302102.414413:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789302102.414426:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789302102.414452:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789302102.414467:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789302102.414494:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789302102.414640:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789302102.414667:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789302102.414681:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789302102.414695:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789302102.414707:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789302102.414718:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789302102.414730:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789302102.414741:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789302102.414753:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789302102.414766:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789302102.414779:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789302102.414844:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789302102.414864:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789302102.414890:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789302102.414907:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789302102.414921:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789302102.414935:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789302102.414949:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789302102.414963:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789302102.414976:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1789302102.415009:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390848:0@lo:502: 00000100:00100000:3.0:1789302102.415066:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302102.415218:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3810849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302102.415317:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121390848 00000100:00100000:0.0:1789302102.415323:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121390848 00000100:00100000:0.0:1789302102.415392:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789302102.415402:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:8438:x1876219121390848:12345-0@lo:502: 00000100:00100000:0.0:1789302102.415615:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:8438:x1876219121390848:12345-0@lo:502: Request processed in 214us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.415623:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789302102.415708:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121390848:0@lo:502: 00000040:00080000:3.0:1789302102.415754:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789302102.415763:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789302102.416353:0:8467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789302102.416377:0:8467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cc3826299c0) 00000020:00000080:3.0:1789302102.416400:0:8467:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789302102.416593:0:8467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc4adc31000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789302102.416597:0:8467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc4adc31000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789302102.416600:0:8467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc4adc31000 3 00010000:00080000:3.0:1789302102.416634:0:8467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc382630800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.109@tcp at head 00010000:00010000:3.0:1789302102.418747:0:8467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789302102.419052:0:8467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789302102.419096:0:8467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789302102.419144:0:8467:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1ff82925bd399099 00000100:00080000:3.0:1789302102.419154:0:8467:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302102.419165:0:8467:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cc382630800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302102.419200:0:8467:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc381f7c380 x1876219121390976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302102.419220:0:8467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789302102.419346:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876219121390976:0@lo:38: 00000100:00100000:1.0:1789302102.419414:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302102.419482:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121390976 00000100:00100000:1.0:1789302102.419489:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121390976 00000100:00100000:1.0:1789302102.419543:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302102.419550:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876219121390976:12345-0@lo:38: 00010000:00080000:1.0:1789302102.419575:0:6531:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:1.0:1789302102.419603:0:6531:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1ff82925bd3990a0 00000004:00100000:1.0:1789302102.419616:0:6531:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789302102.419644:0:6531:0:(import.c:65:import_set_state_nolock()) ffff8cc381fc8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302102.419690:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876219121390976:12345-0@lo:38: Request processed in 139us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.419696:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789302102.419733:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc381f7c380 x1876219121390976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302102.419743:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789302102.419749:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789302102.419756:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789302102.419760:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789302102.419762:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc382630800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789302102.419767:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876219121390976:0@lo:38: 00000020:01000004:1.0:1789302102.419981:0:8467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789302102.419997:0:8467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8cc381fc0000) 00000020:00000080:1.0:1789302102.420012:0:8467:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1789302102.420095:0:8467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc4adc31000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789302102.420100:0:8467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc4adc31000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789302102.420103:0:8467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc4adc31000 3 00010000:00080000:1.0:1789302102.420144:0:8467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc381fcb000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.109@tcp at head 00010000:00010000:1.0:1789302102.422231:0:8467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:0.0:1789302102.422989:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121391232:0@lo:400: 00000100:00100000:0.0:1789302102.423052:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302102.423087:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302102.423094:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121391104:0@lo:400: 00000100:00100000:0.0:1789302102.423133:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302102.423159:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302102.423166:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121391360:0@lo:400: 00000100:00100000:0.0:1789302102.423191:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302102.423221:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121391232 00000100:00100000:0.0:1789302102.423229:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121391232 00000100:00100000:0.0:1789302102.423270:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121391104 00000100:00100000:0.0:1789302102.423274:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121391104 00000100:00100000:0.0:1789302102.423288:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302102.423297:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121391232:12345-0@lo:400: 00000100:00100000:0.0:1789302102.423346:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121391232:12345-0@lo:400: Request processed in 50us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.423353:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302102.423368:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302102.423374:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121391104:12345-0@lo:400: 00000100:00100000:0.0:1789302102.423400:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121391104:12345-0@lo:400: Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.423405:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302102.423425:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121391360 00000100:00100000:0.0:1789302102.423429:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121391360 00000100:00100000:0.0:1789302102.423452:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302102.423459:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121391360:12345-0@lo:400: 00000100:00100000:0.0:1789302102.423784:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121391360:12345-0@lo:400: Request processed in 323us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.423800:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:1.0:1789302102.427038:0:8467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789302102.427077:0:8467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789302102.427087:0:8467:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x1ff82925bd3990ae 00000100:00080000:1.0:1789302102.427099:0:8467:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789302102.427129:0:8467:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8cc381fcb000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302102.427164:0:8467:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4b5283100 x1876219121391488/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302102.427194:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876219121391488:0@lo:38: 00000100:00100000:1.0:1789302102.427255:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789302102.427311:0:8467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1789302102.427450:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1789302102.427709:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121391488 00000100:00100000:0.0:1789302102.427716:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121391488 00000100:00100000:0.0:1789302102.427768:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789302102.427775:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876219121391488:12345-0@lo:38: 00010000:00080000:0.0:1789302102.427801:0:6530:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:0.0:1789302102.427833:0:6530:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x1ff82925bd3990b5 00000004:00100000:0.0:1789302102.427847:0:6530:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789302102.427875:0:6530:0:(import.c:65:import_set_state_nolock()) ffff8cc4b52a4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302102.427930:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876219121391488:12345-0@lo:38: Request processed in 154us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.427937:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789302102.427977:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b5283100 x1876219121391488/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302102.427987:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789302102.427995:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789302102.428000:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789302102.428005:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789302102.428006:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc381fcb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789302102.428011:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876219121391488:0@lo:38: 00000100:00100000:0.0:1789302102.428056:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121391360:0@lo:400: 00010000:00080000:0.0:1789302102.428080:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc381f74700 x1876219121391104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302102.428088:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121391104:0@lo:400: 00010000:00080000:0.0:1789302102.428133:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc381f75c00 x1876219121391232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302102.428142:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121391232:0@lo:400: 00000020:01000000:1.0:1789302102.429570:0:8438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789302102.429611:0:8438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789302102.429632:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.429643:0:8438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789302102.429691:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789302102.429696:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789302102.429697:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302102.429698:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302102.429699:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302102.429701:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302102.429702:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789302102.429703:0:8438:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789302102.429704:0:8438:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789302102.429706:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302102.429707:0:8438:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789302102.429710:0:8438:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789302102.429711:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789302102.429713:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789302102.429713:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302102.429714:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302102.429715:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302102.429716:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302102.429717:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789302102.429718:0:8438:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789302102.429718:0:8438:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789302102.429719:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302102.429720:0:8438:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789302102.429740:0:8438:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789302102.429755:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121391616:0@lo:253: 00000100:00100000:1.0:1789302102.429811:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302102.429846:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121391616 00000100:00100000:1.0:1789302102.429852:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121391616 00000100:00100000:1.0:1789302102.430241:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789302102.430249:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:8438:x1876219121391616:12345-0@lo:253: 20000000:01000000:1.0:1789302102.430273:0:6524:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789302102.430285:0:6524:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789302102.430397:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4856fed80 going to sleep for 11 seconds 00010000:00010000:1.0:1789302102.430413:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1789302102.438614:0:6524:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789302102.438673:0:6524:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789302102.438991:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:8438:x1876219121391616:12345-0@lo:253: Request processed in 8737us (9173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.439015:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789302102.439364:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:8438:1876219121391616:0@lo:253: 10000000:01000000:2.0:1789302102.439379:0:8438:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789302102.439382:0:8438:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789302102.439384:0:8438:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789302102.439385:0:8438:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302102.439387:0:8438:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302102.439388:0:8438:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302102.439390:0:8438:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302102.439392:0:8438:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302102.439394:0:8438:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302102.439396:0:8438:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302102.439398:0:8438:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302102.439400:0:8438:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 20000000:01000000:3.0:1789302102.439721:0:6546:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789302102.439727:0:6546:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789302102.439747:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.439762:0:6546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48166f800/0x1ff82925bd398fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398fab expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.439770:0:6546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48166f400/0x1ff82925bd398fce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd398fc7 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.439777:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.439813:0:6546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48166f400/0x1ff82925bd398fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398fc7 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.439827:0:6546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc48166f400/0x1ff82925bd398fce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398fc7 expref: 15 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302102.439840:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121391744:0@lo:104: 00000100:00100000:3.0:1789302102.439901:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789302102.439953:0:6546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48166f800/0x1ff82925bd398fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd398fab expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.439962:0:6546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc48166f800/0x1ff82925bd398fb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd398fab expref: 15 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302102.439973:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789302102.439986:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121391872:0@lo:104: 00000100:00100000:1.0:1789302102.439992:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121391744 00000100:00100000:1.0:1789302102.439999:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121391744 00000100:00100000:3.0:1789302102.440012:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:2.0:1789302102.440049:0:8438:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789302102.440094:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc381084540 going to sleep for 11 seconds 00000100:00100000:1.0:1789302102.442736:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121391872 00000100:00100000:1.0:1789302102.442757:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121391872 00000100:00100000:1.0:1789302102.442809:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789302102.442827:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:6546:x1876219121391744:12345-0@lo:104: 00010000:00010000:1.0:1789302102.442844:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ec00/0x1ff82925bd398fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.443046:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302102.443052:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121391744:0@lo:104: 00000100:00100000:1.0:1789302102.443061:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:6546:x1876219121391744:12345-0@lo:104: Request processed in 242us (3158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.443069:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789302102.443141:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789302102.443157:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:6546:x1876219121391872:12345-0@lo:104: 00010000:00010000:1.0:1789302102.443167:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd398fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.443231:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789302102.443236:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:6546:x1876219121391872:12345-0@lo:104: Request processed in 90us (3225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302102.443241:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789302102.443266:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302102.443272:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ec00/0x1ff82925bd398fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302102.443291:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121391872:0@lo:104: 00010000:00010000:1.0:1789302102.443310:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538ec00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302102.443315:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ec00/0x1ff82925bd398fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.443317:0:6546:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.443340:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ec00/0x1ff82925bd398fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302102.443348:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ec00/0x1ff82925bd398fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302102.443355:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302102.443402:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ec00/0x1ff82925bd398fc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.443413:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789302102.443568:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302102.443583:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121392000:0@lo:103: 00000100:00100000:3.0:1789302102.443620:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302102.443652:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121392000 00000100:00100000:3.0:1789302102.443656:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121392000 00010000:00010000:3.0:1789302102.443674:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48166f400/0x1ff82925bd398fce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398fc7 expref: 16 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302102.443695:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789302102.443702:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+16:3645:x1876219121392000:12345-0@lo:103: 00010000:00010000:3.0:1789302102.443712:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302102.443717:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48166f400/0x1ff82925bd398fce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398fc7 expref: 16 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.443737:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48166f400/0x1ff82925bd398fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398fc7 expref: 16 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.443750:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166f400/0x1ff82925bd398fce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398fc7 expref: 16 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.443763:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302102.443789:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+15:3645:x1876219121392000:12345-0@lo:103: Request processed in 87us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302102.443795:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789302102.443819:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121392000:0@lo:103: 00010000:00010000:1.0:1789302102.444038:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ec00/0x1ff82925bd398fc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.444054:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ec00/0x1ff82925bd398fc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fce expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.444066:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302102.444069:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd398fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.444074:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983200 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302102.444084:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd398fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.444102:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd398fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302102.444109:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd398fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302102.444142:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302102.444159:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd398fab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.444164:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302102.444193:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd398fab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.444199:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd398fab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd398fb2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302102.444212:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302102.444214:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302102.444216:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302102.444229:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302102.444682:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121392128:0@lo:103: 00000100:00100000:3.0:1789302102.444723:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302102.444840:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121392128 00000100:00100000:0.0:1789302102.444847:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121392128 00010000:00010000:0.0:1789302102.444870:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48166f800/0x1ff82925bd398fb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398fab expref: 15 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302102.444978:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302102.444988:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+15:3647:x1876219121392128:12345-0@lo:103: 00010000:00010000:0.0:1789302102.445000:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302102.445005:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48166f800/0x1ff82925bd398fb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd398fab expref: 15 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.445017:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48166f800/0x1ff82925bd398fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd398fab expref: 15 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.445031:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166f800/0x1ff82925bd398fb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd398fab expref: 15 pid: 6523 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.445044:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.445052:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789302102.445077:0:6517:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005339851s 00010000:00010000:0.0:1789302102.445083:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.445104:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.445832:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.445845:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.445853:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166fa00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302102.445857:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.445867:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.446043:0:6546:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302102.446054:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.446669:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.446681:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd3990bc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302102.446699:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302102.446814:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+14:3647:x1876219121392128:12345-0@lo:103: Request processed in 1825us (2088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302102.446824:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789302102.446975:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121392128:0@lo:103: 00080000:10000000:2.0:1789302102.447716:0:8438:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789302102.447858:0:8438:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789302102.448018:0:8438:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789302102.448235:0:8438:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789302102.448596:0:8438:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789302102.448895:0:8438:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789302102.451003:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789302102.459721:0:8438:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789302102.459730:0:8438:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789302102.459762:0:8438:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789302102.459920:0:8438:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789302102.459941:0:8438:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789302102.459964:0:8438:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789302102.460718:0:8438:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789302102.460874:0:8438:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:2.0:1789302103.283308:0:8523:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789302103.284271:0:8523:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789302103.450916:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302104.468305:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302105.492743:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302106.198905:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121392256:0@lo:41: 00000100:00100000:0.0:1789302106.198984:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302106.199140:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121392256 00000100:00100000:1.0:1789302106.199149:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121392256 00000100:00100000:1.0:1789302106.199203:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789302106.199212:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121392256:12345-0@lo:41: 00000004:00000024:1.0:1789302106.199245:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789302106.203397:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121392256:12345-0@lo:41: Request processed in 4175us (4403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302106.203412:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789302106.204924:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121392256:0@lo:41: 00010000:00010000:1.0:1789302106.516234:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302107.228204:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302107.228231:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121392384:0@lo:41: 00000100:00100000:0.0:1789302107.228303:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302107.228373:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121392384 00000100:00100000:0.0:1789302107.228381:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121392384 00000100:00100000:0.0:1789302107.228426:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789302107.228436:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121392384:12345-0@lo:41: 00000004:00000024:0.0:1789302107.228478:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789302107.228533:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121392384:12345-0@lo:41: Request processed in 98us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302107.228539:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789302107.229092:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121392384:0@lo:41: 00010000:00010000:2.0:1789302107.540418:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302107.732768:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121392896:0@lo:400: 00000100:00100000:1.0:1789302107.732838:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302107.732898:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789302107.732904:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121392512:0@lo:400: 00000100:00100000:1.0:1789302107.732932:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302107.732961:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121393024:0@lo:400: 00000100:00100000:1.0:1789302107.732984:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302107.733010:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121392640:0@lo:400: 00000100:00100000:1.0:1789302107.733031:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302107.733047:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121393152:0@lo:400: 00000100:00100000:1.0:1789302107.733067:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302107.733083:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302107.733089:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121392768:0@lo:400: 00000100:00100000:1.0:1789302107.733109:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302107.733225:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121392896 00000100:00100000:1.0:1789302107.733234:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121392896 00000100:00100000:1.0:1789302107.733279:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789302107.733289:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121392896:12345-0@lo:400: 00000100:00100000:1.0:1789302107.733344:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121392896:12345-0@lo:400: Request processed in 56us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302107.733351:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789302107.733374:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121393024 00000100:00100000:1.0:1789302107.733377:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121393024 00000100:00100000:1.0:1789302107.733416:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121392640 00000100:00100000:1.0:1789302107.733419:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121392640 00000100:00100000:1.0:1789302107.733431:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121393152 00000100:00100000:1.0:1789302107.733433:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121393152 00000100:00100000:1.0:1789302107.733456:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121392768 00000100:00100000:1.0:1789302107.733459:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121392768 00000100:00100000:1.0:1789302107.733472:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789302107.733478:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121393024:12345-0@lo:400: 00000100:00100000:1.0:1789302107.733639:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121393024:12345-0@lo:400: Request processed in 161us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302107.733645:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789302107.733658:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789302107.733664:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121392640:12345-0@lo:400: 00000100:00100000:1.0:1789302107.733695:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121392640:12345-0@lo:400: Request processed in 31us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302107.733702:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789302107.733713:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789302107.733719:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121393152:12345-0@lo:400: 00000100:00100000:1.0:1789302107.733743:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121393152:12345-0@lo:400: Request processed in 25us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302107.733749:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789302107.733758:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789302107.733764:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121392768:12345-0@lo:400: 00000100:00100000:1.0:1789302107.733786:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121392768:12345-0@lo:400: Request processed in 23us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302107.733792:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789302107.733834:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b5280e00 x1876219121392768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302107.733855:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121392768:0@lo:400: 00010000:00080000:1.0:1789302107.733868:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b5283480 x1876219121392640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302107.733875:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121392640:0@lo:400: 00010000:00080000:1.0:1789302107.733884:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc382914380 x1876219121393152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302107.733892:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121393152:0@lo:400: 00010000:00080000:1.0:1789302107.733923:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc382917800 x1876219121393024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302107.733931:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121393024:0@lo:400: 00000100:00100000:1.0:1789302107.733940:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121392896:0@lo:400: 00000100:00100000:0.0:1789302107.734259:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121392512 00000100:00100000:0.0:1789302107.734265:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121392512 00000100:00100000:0.0:1789302107.734305:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789302107.734312:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+14:3645:x1876219121392512:12345-0@lo:400: 00000100:00100000:0.0:1789302107.734348:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+14:3645:x1876219121392512:12345-0@lo:400: Request processed in 38us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302107.734354:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1789302107.734381:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302107.734385:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302107.734481:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121392512:0@lo:400: 00010000:00010000:1.0:1789302108.564361:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789302108.649519:0:8813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1789302109.269375:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789302109.269387:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4b511e800 from 30 10000000:01000000:0.0:1789302109.269395:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789302109.269464:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.269500:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.269517:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302109.269549:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121393280:0@lo:101: 00000100:00100000:0.0:1789302109.269640:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.269696:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1789302109.273695:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121393280 00000100:00100000:0.0:1789302109.273727:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121393280 00000100:00100000:0.0:1789302109.273809:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789302109.273823:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+14:6527:x1876219121393280:12345-0@lo:101: 00010000:00010000:0.0:1789302109.273846:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302109.273873:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538e600/0x1ff82925bd3990ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3990c3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.273913:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538e600/0x1ff82925bd3990ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3990c3 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.273926:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538e600/0x1ff82925bd3990ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3990c3 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.273939:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538e600, rc 0) 00000100:00100000:0.0:1789302109.274039:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121393280:12345-0@lo:101: Request processed in 219us (4398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302109.274046:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789302109.274142:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121393280:0@lo:101: 00010000:00010000:0.0:1789302109.274180:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.274193:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302109.279058:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121393408:0@lo:501: 00000100:00100000:0.0:1789302109.279169:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.279229:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1789302109.282801:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121393408 00000100:00100000:3.0:1789302109.282823:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121393408 00000100:00100000:3.0:1789302109.282964:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789302109.282977:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121393408:12345-0@lo:501: 00000100:00100000:3.0:1789302109.286006:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121393408:12345-0@lo:501: Request processed in 3017us (6821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302109.286027:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789302109.286203:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121393408:0@lo:501: 00000100:00100000:1.0:1789302109.286278:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121393536:0@lo:503: 00000100:00100000:1.0:1789302109.286347:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302109.292395:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4887650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302109.295206:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121393536 00000100:00100000:0.0:1789302109.295228:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121393536 00000100:00100000:0.0:1789302109.295314:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789302109.295327:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121393536:12345-0@lo:503: 00000100:00100000:0.0:1789302109.295648:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121393536:12345-0@lo:503: Request processed in 323us (9311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302109.295656:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789302109.295807:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121393536:0@lo:503: 00000100:00100000:0.0:1789302109.296091:0:8839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8839:1876219121393664:0@lo:502: 00000100:00100000:0.0:1789302109.298684:0:8839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302109.299317:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121393664 00000100:00100000:1.0:1789302109.299332:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121393664 00000100:00100000:1.0:1789302109.299494:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789302109.299509:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:8839:x1876219121393664:12345-0@lo:502: 00000100:00100000:1.0:1789302109.299700:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:8839:x1876219121393664:12345-0@lo:502: Request processed in 194us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.299727:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789302109.299889:0:8839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc482ff6780 going to sleep for 11 seconds 00000100:00100000:0.0:1789302109.299917:0:8839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8839:1876219121393664:0@lo:502: 00000100:00100000:0.0:1789302109.300001:0:8839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8839:1876219121393792:0@lo:502: 00000100:00100000:0.0:1789302109.300043:0:8839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.300055:0:8839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc482ff6780 going to sleep for 11 seconds 00000100:00100000:3.0:1789302109.300422:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121393792 00000100:00100000:3.0:1789302109.300437:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121393792 00000100:00100000:3.0:1789302109.300482:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789302109.300491:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:8839:x1876219121393792:12345-0@lo:502: 00000100:00100000:3.0:1789302109.300596:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:8839:x1876219121393792:12345-0@lo:502: Request processed in 107us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302109.300605:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789302109.301801:0:8839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8839:1876219121393792:0@lo:502: 00000040:00080000:0.0:1789302109.301859:0:8839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789302109.301952:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789302109.301973:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789302109.301987:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.301999:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302109.302010:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789302109.302014:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b511e800 from 5 10000000:01000000:0.0:1789302109.302018:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789302109.302063:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.302072:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.302082:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302109.302103:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121393920:0@lo:101: 00000100:00100000:0.0:1789302109.303593:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.303646:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc482ff6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302109.304088:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121393920 00000100:00100000:1.0:1789302109.304100:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121393920 00000100:00100000:3.0:1789302109.304351:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789302109.304366:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121393920:12345-0@lo:101: 00010000:00010000:3.0:1789302109.304388:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302109.304416:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166f200/0x1ff82925bd3990d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3990d1 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302109.304460:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166f200/0x1ff82925bd3990d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3990d1 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302109.304475:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166f200/0x1ff82925bd3990d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3990d1 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302109.304485:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f200, rc 0) 00000100:00100000:3.0:1789302109.304546:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121393920:12345-0@lo:101: Request processed in 184us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302109.304554:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789302109.304611:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121393920:0@lo:101: 00010000:00010000:3.0:1789302109.304630:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302109.304640:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302109.304736:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121394048:0@lo:256: 00000100:00100000:3.0:1789302109.304776:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302109.304801:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc490b73300 going to sleep for 11 seconds 00000100:00100000:1.0:1789302109.304947:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121394048 00000100:00100000:1.0:1789302109.304952:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121394048 00000100:00100000:1.0:1789302109.304988:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789302109.304996:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121394048:12345-0@lo:256: 20000000:01000000:1.0:1789302109.305013:0:6524:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789302109.305034:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789302109.305038:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789302109.305161:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121394048:12345-0@lo:256: Request processed in 166us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.305169:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789302109.305316:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121394048:0@lo:256: 10000000:01000000:1.0:1789302109.305436:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789302109.305444:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302109.305454:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302109.305465:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789302109.305467:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1789302109.305471:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789302109.305496:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302109.305505:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302109.305522:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302109.305536:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121394176:0@lo:101: 00000100:00100000:1.0:1789302109.305565:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302109.305580:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc488765300 going to sleep for 11 seconds 00000100:00100000:1.0:1789302109.305592:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121394176 00000100:00100000:1.0:1789302109.305596:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121394176 00000100:00100000:1.0:1789302109.305619:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789302109.305627:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121394176:12345-0@lo:101: 00010000:00010000:1.0:1789302109.305636:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302109.305648:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4c2179c00/0x1ff82925bd3990e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3990df expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302109.305666:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2179c00/0x1ff82925bd3990e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3990df expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302109.305675:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4c2179c00/0x1ff82925bd3990e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3990df expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302109.305683:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2179c00, rc 0) 00000100:00100000:1.0:1789302109.305714:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121394176:12345-0@lo:101: Request processed in 87us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.307482:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789302109.307575:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121394176:0@lo:101: 00010000:00010000:1.0:1789302109.307604:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302109.307632:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302109.307726:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121394304:0@lo:501: 00000100:00100000:1.0:1789302109.307779:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302109.307824:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fc600 going to sleep for 11 seconds 00000100:00100000:3.0:1789302109.308856:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121394304 00000100:00100000:3.0:1789302109.308869:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121394304 00000100:00100000:3.0:1789302109.308926:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789302109.308937:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121394304:12345-0@lo:501: 00000100:00100000:3.0:1789302109.309175:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121394304:12345-0@lo:501: Request processed in 239us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302109.309184:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789302109.309504:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382914380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121394304:0@lo:501: 00000100:00100000:0.0:1789302109.309564:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121394432:0@lo:503: 00000100:00100000:0.0:1789302109.309623:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.309668:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc482ff6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302109.312692:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121394432 00000100:00100000:1.0:1789302109.312715:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121394432 00000100:00100000:1.0:1789302109.312825:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789302109.312838:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121394432:12345-0@lo:503: 00000100:00100000:1.0:1789302109.313057:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121394432:12345-0@lo:503: Request processed in 222us (3434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.313066:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789302109.313255:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121394432:0@lo:503: 00000100:00100000:0.0:1789302109.313589:0:8840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8840:1876219121394560:0@lo:502: 00000100:00100000:0.0:1789302109.313642:0:8840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.313671:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121394560 00000100:00100000:0.0:1789302109.313676:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121394560 00000100:00100000:0.0:1789302109.313705:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789302109.313713:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:8840:x1876219121394560:12345-0@lo:502: 00000100:00100000:0.0:1789302109.313804:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:8840:x1876219121394560:12345-0@lo:502: Request processed in 91us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302109.313811:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789302109.313856:0:8840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc482ff63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302109.313869:0:8840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8840:1876219121394560:0@lo:502: 00000020:01000000:0.0:1789302109.313892:0:8840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789302109.313900:0:8840:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789302109.313908:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302109.313910:0:8840:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789302109.313916:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789302109.313921:0:8840:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:01000000:0.0:1789302109.313949:0:8840:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789302109.313952:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789302109.313972:0:8840:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8cc4b50bb380) 00000020:00000080:0.0:1789302109.314001:0:8840:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1789302109.314008:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789302109.314157:0:8840:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789302109.314165:0:8840:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789302109.314173:0:8840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd3990f4 00010000:00080000:0.0:1789302109.314210:0:8840:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc4b50b5800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.109@tcp at head 00010000:00010000:0.0:1789302109.314497:0:8840:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789302109.343265:0:8840:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789302109.343296:0:8840:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789302109.343626:0:8840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302109.343934:0:8840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302109.344034:0:8840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789302109.344882:0:8840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789302109.346473:0:8842:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302109.346482:0:8842:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789302109.354962:0:8840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789302109.354984:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789302109.355049:0:8840:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789302109.355083:0:8840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd3990fb 00000100:00080000:3.0:1789302109.355099:0:8840:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302109.355437:0:8840:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cc4b50b5800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302109.355516:0:8840:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc381f7e680 x1876219121394688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302109.355541:0:8840:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789302109.355625:0:8840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302109.355630:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302109.355632:0:8840:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789302109.355635:0:8840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302109.355639:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302109.355641:0:8840:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789302109.355644:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789302109.355646:0:8840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789302109.355682:0:8840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8840:1876219121394816:0@lo:502: 00000100:00100000:2.0:1789302109.356477:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121394944:0@lo:400: 00000100:00100000:2.0:1789302109.356558:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.356619:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121395456:0@lo:400: 00000100:00100000:2.0:1789302109.356649:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.356678:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302109.356685:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121395328:0@lo:400: 00000100:00100000:2.0:1789302109.356712:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.356764:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121395072:0@lo:400: 00000100:00100000:2.0:1789302109.356788:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.356808:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121395584:0@lo:400: 00000100:00100000:2.0:1789302109.356832:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.356850:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302109.356856:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121395200:0@lo:400: 00000100:00100000:2.0:1789302109.356881:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.356917:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121394944 00000100:00100000:2.0:1789302109.356927:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121394944 00000100:00100000:2.0:1789302109.356981:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121395456 00000100:00100000:2.0:1789302109.356984:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121395456 00000100:00100000:2.0:1789302109.357012:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121395584 00000100:00100000:2.0:1789302109.357015:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121395584 00000100:00100000:2.0:1789302109.357028:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121395200 00000100:00100000:2.0:1789302109.357031:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121395200 00000100:00100000:2.0:1789302109.357047:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789302109.357058:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121394944:12345-0@lo:400: 00000100:00100000:3.0:1789302109.357618:0:8840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302109.357655:0:8840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc490b736c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.357958:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121394944:12345-0@lo:400: Request processed in 900us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.357968:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789302109.358010:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302109.358021:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121395456:12345-0@lo:400: 00000100:00100000:2.0:1789302109.358059:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121395456:12345-0@lo:400: Request processed in 42us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.358064:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302109.358077:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789302109.358084:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121395584:12345-0@lo:400: 00000100:00100000:2.0:1789302109.358148:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121395584:12345-0@lo:400: Request processed in 65us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.358153:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789302109.358165:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789302109.358172:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121395200:12345-0@lo:400: 00000100:00100000:2.0:1789302109.358268:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121395200:12345-0@lo:400: Request processed in 97us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.358274:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789302109.358304:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121395328 00000100:00100000:2.0:1789302109.358310:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121395328 00000100:00100000:2.0:1789302109.358409:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121395072 00000100:00100000:2.0:1789302109.358413:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121395072 00000100:00100000:2.0:1789302109.358440:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789302109.358447:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121395328:12345-0@lo:400: 00000100:00100000:2.0:1789302109.358483:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121395328:12345-0@lo:400: Request processed in 36us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.358488:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789302109.358499:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789302109.358506:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121395072:12345-0@lo:400: 00000100:00100000:2.0:1789302109.358533:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121395072:12345-0@lo:400: Request processed in 28us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.358547:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789302109.358577:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302109.358583:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302109.360330:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121394816 00000100:00100000:0.0:1789302109.360359:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121394816 00000100:00100000:0.0:1789302109.360535:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789302109.360545:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:8840:x1876219121394816:12345-0@lo:502: 00000100:00100000:0.0:1789302109.360718:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:8840:x1876219121394816:12345-0@lo:502: Request processed in 174us (3101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302109.360725:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789302109.360783:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121394688:0@lo:8: 00000100:00100000:0.0:1789302109.360824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789302109.361322:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc485dd1180 x1876219121395200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302109.361351:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121395200:0@lo:400: 00000100:00100000:3.0:1789302109.361365:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121395072:0@lo:400: 00010000:00080000:3.0:1789302109.361383:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc485dd1c00 x1876219121395584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302109.361392:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121395584:0@lo:400: 00000100:00100000:3.0:1789302109.361652:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121394688 00000100:00100000:3.0:1789302109.361659:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121394688 00000100:00100000:3.0:1789302109.361695:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302109.361701:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876219121394688:12345-0@lo:8: 00010000:00080000:3.0:1789302109.361735:0:8445:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1789302109.361772:0:8445:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd399102 00002000:00100000:3.0:1789302109.361822:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8cc382632800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789302109.361827:0:8445:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1789302109.361841:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789302109.361917:0:8445:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789302109.362404:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789302109.362449:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cc382631000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302109.362545:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876219121394688:12345-0@lo:8: Request processed in 842us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302109.362554:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302109.362613:0:8840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8840:1876219121394816:0@lo:502: 00000020:01000000:3.0:1789302109.362658:0:8840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302109.362667:0:8840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302109.362670:0:8840:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789302109.362676:0:8840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1789302109.365552:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1789302109.365599:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789302109.365614:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.365630:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302109.365644:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789302109.365647:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4b863d000 from 30 10000000:01000000:2.0:1789302109.365651:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789302109.365700:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.365709:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.365720:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302109.365749:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121395712:0@lo:101: 00000100:00100000:2.0:1789302109.365830:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.365889:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.365923:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121395712 00000100:00100000:2.0:1789302109.365932:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121395712 00000100:00100000:2.0:1789302109.365991:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789302109.366002:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121395712:12345-0@lo:101: 00010000:00010000:2.0:1789302109.366031:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302109.366047:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983800/0x1ff82925bd399110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399109 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.366079:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983800/0x1ff82925bd399110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399109 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.366092:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa983800/0x1ff82925bd399110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399109 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.366101:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983800, rc 0) 00010000:00080000:1.0:1789302109.366329:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc485dd1880 x1876219121394944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302109.366412:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121394944:0@lo:400: 00010000:00080000:1.0:1789302109.366442:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc485dd1f80 x1876219121395456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302109.366451:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121395456:0@lo:400: 00000100:00100000:1.0:1789302109.366482:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121395328:0@lo:400: 00000100:00100000:2.0:1789302109.366729:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121395712:12345-0@lo:101: Request processed in 728us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.366739:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:0.0:1789302109.367607:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f7e680 x1876219121394688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302109.367624:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789302109.367642:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789302109.367659:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789302109.367670:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789302109.367676:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b50b5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789302109.367709:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789302109.367720:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121394688:0@lo:8: 00000100:00100000:2.0:1789302109.368970:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121395712:0@lo:101: 00010000:00010000:2.0:1789302109.369009:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.369028:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302109.369528:0:8843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382916680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8843:1876219121395840:0@lo:700: 00000100:00100000:1.0:1789302109.369616:0:8843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302109.369664:0:8843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.371489:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121395968:0@lo:501: 00000100:00100000:2.0:1789302109.371567:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.371613:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd900 going to sleep for 11 seconds 00000100:00100000:0.0:1789302109.372377:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121395840 00000100:00100000:0.0:1789302109.372392:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121395840 00000100:00100000:0.0:1789302109.372483:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302109.372496:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8843:x1876219121395840:12345-0@lo:700: 00000100:00100000:0.0:1789302109.372560:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8453:1876219121396096:0@lo:700: 00000100:00100000:0.0:1789302109.372614:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.372642:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc482ff6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302109.372689:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121396096 00000100:00100000:0.0:1789302109.372693:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121396096 00000100:00100000:0.0:1789302109.372725:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302109.372742:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8453:x1876219121396096:12345-0@lo:700: 00000100:00100000:1.0:1789302109.373063:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121395968 00000100:00100000:1.0:1789302109.373074:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121395968 00000100:00100000:1.0:1789302109.373106:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789302109.373133:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121395968:12345-0@lo:501: 00000100:00100000:1.0:1789302109.373325:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121395968:12345-0@lo:501: Request processed in 194us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.373464:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1789302109.373596:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302109.373645:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121395968:0@lo:501: 00000100:00100000:2.0:1789302109.373694:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121396224:0@lo:503: 00000100:00100000:2.0:1789302109.373758:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.373788:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302109.373847:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121396224 00000100:00100000:1.0:1789302109.373852:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121396224 00000100:00100000:1.0:1789302109.373891:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789302109.373898:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121396224:12345-0@lo:503: 00000100:00100000:1.0:1789302109.373991:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121396224:12345-0@lo:503: Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.373998:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789302109.374088:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121396224:0@lo:503: 00000004:00080000:2.0:1789302109.379498:0:8842:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789302109.379617:0:8842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 185422503455ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789302109.379628:0:8842:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789302109.384326:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789302109.386305:0:8844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8844:1876219121396352:0@lo:502: 00000100:00100000:0.0:1789302109.386542:0:8844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.386593:0:8844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0ab0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.386900:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121396352 00000100:00100000:2.0:1789302109.386909:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121396352 00000100:00100000:2.0:1789302109.386975:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789302109.386986:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:8844:x1876219121396352:12345-0@lo:502: 00000100:00100000:2.0:1789302109.387175:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:8844:x1876219121396352:12345-0@lo:502: Request processed in 190us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.387184:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789302109.387711:0:8844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8844:1876219121396352:0@lo:502: 00000100:00100000:0.0:1789302109.387878:0:8844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8844:1876219121396480:0@lo:502: 00000100:00100000:0.0:1789302109.387938:0:8844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.387971:0:8844:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852c4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.388896:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121396480 00000100:00100000:2.0:1789302109.388907:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121396480 00000100:00100000:2.0:1789302109.388970:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789302109.388980:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:8844:x1876219121396480:12345-0@lo:502: 00000100:00100000:2.0:1789302109.389155:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:8844:x1876219121396480:12345-0@lo:502: Request processed in 177us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.389164:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789302109.389483:0:8844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8844:1876219121396480:0@lo:502: 00000040:00080000:0.0:1789302109.389520:0:8844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789302109.391662:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789302109.391712:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302109.391741:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.391756:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302109.391786:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789302109.391790:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b863d000 from 5 10000000:01000000:2.0:1789302109.391793:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789302109.391845:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.391854:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.391869:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302109.391896:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121396608:0@lo:101: 00000100:00100000:2.0:1789302109.391972:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.392020:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302109.392240:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121396608 00000100:00100000:0.0:1789302109.392251:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121396608 00000100:00100000:0.0:1789302109.392316:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789302109.392327:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121396608:12345-0@lo:101: 00010000:00010000:0.0:1789302109.392353:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302109.392371:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd39911e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399117 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.392401:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd39911e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399117 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.392414:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd39911e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399117 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302109.392435:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538ee00, rc 0) 00000100:00100000:0.0:1789302109.392485:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121396608:12345-0@lo:101: Request processed in 161us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302109.392504:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 40000000:02000000:0.0:1789302109.392608:0:6537:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1789302109.396534:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121396608:0@lo:101: 00010000:00010000:1.0:1789302109.396579:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302109.396595:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302109.396708:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121396736:0@lo:256: 00000100:00100000:1.0:1789302109.396795:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302109.396848:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.410527:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121396736 00000100:00100000:2.0:1789302109.410548:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121396736 00000100:00100000:2.0:1789302109.410625:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789302109.410637:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121396736:12345-0@lo:256: 20000000:01000000:2.0:1789302109.410670:0:6524:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789302109.410695:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789302109.410698:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789302109.410865:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121396736:12345-0@lo:256: Request processed in 230us (14068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.410873:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789302109.410937:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121396736:0@lo:256: 10000000:01000000:2.0:1789302109.411002:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789302109.411019:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.411031:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302109.411042:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789302109.411045:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789302109.411048:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789302109.411088:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.411097:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.411108:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302109.411154:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121396864:0@lo:101: 00000100:00100000:2.0:1789302109.411192:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.411225:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd180 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.411240:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121396864 00000100:00100000:2.0:1789302109.411245:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121396864 00000100:00100000:2.0:1789302109.411272:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789302109.411279:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121396864:12345-0@lo:101: 00010000:00010000:2.0:1789302109.411289:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302109.411305:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39912c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399125 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.411329:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39912c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399125 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.411349:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39912c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399125 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.411359:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983e00, rc 0) 00000100:00100000:2.0:1789302109.411389:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121396864:12345-0@lo:101: Request processed in 110us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.411395:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789302109.411441:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121396864:0@lo:101: 00010000:00010000:2.0:1789302109.411455:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.411465:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302109.411522:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121396992:0@lo:501: 00000100:00100000:2.0:1789302109.411550:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.411564:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd180 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.411575:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121396992 00000100:00100000:2.0:1789302109.411579:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121396992 00000100:00100000:2.0:1789302109.411596:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789302109.411601:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48534b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121396992:12345-0@lo:501: 00000100:00100000:2.0:1789302109.411739:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48534b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121396992:12345-0@lo:501: Request processed in 136us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.411746:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789302109.411774:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121396992:0@lo:501: 00000100:00100000:2.0:1789302109.411799:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121397120:0@lo:503: 00000100:00100000:2.0:1789302109.411848:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.411861:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd180 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.411872:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121397120 00000100:00100000:2.0:1789302109.411876:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121397120 00000100:00100000:2.0:1789302109.411894:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789302109.411900:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121397120:12345-0@lo:503: 00000100:00100000:2.0:1789302109.411978:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121397120:12345-0@lo:503: Request processed in 78us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.411985:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789302109.412022:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121397120:0@lo:503: 00000100:00100000:2.0:1789302109.412280:0:8845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8845:1876219121397248:0@lo:502: 00000100:00100000:2.0:1789302109.412314:0:8845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.412333:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121397248 00000100:00100000:2.0:1789302109.412337:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121397248 00000100:00100000:2.0:1789302109.412359:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789302109.412364:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4883a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:8845:x1876219121397248:12345-0@lo:502: 00000100:00100000:2.0:1789302109.412457:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4883a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:8845:x1876219121397248:12345-0@lo:502: Request processed in 93us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.412465:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789302109.412495:0:8845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdde40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.412506:0:8845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8845:1876219121397248:0@lo:502: 00000020:01000000:2.0:1789302109.412529:0:8845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789302109.412538:0:8845:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789302109.412548:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302109.412550:0:8845:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789302109.412556:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789302109.412566:0:8845:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:01000000:2.0:1789302109.412596:0:8845:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789302109.412599:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789302109.412620:0:8845:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cc4bd97b380) 00000020:00000080:2.0:1789302109.412648:0:8845:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1789302109.412654:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789302109.412752:0:8845:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789302109.412759:0:8845:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789302109.412767:0:8845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd39913a 00010000:00080000:2.0:1789302109.412804:0:8845:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc4b7e9f000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.109@tcp at head 00010000:00010000:2.0:1789302109.413056:0:8845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:1.0:1789302109.414082:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8453:x1876219121396096:12345-0@lo:700: Request processed in 41334us (41460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.414097:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789302109.417246:0:8453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f77b80 x1876219121396096/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789302125 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302109.417284:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8453:1876219121396096:0@lo:700: 40000000:02000000:1.0:1789302109.417306:0:8453:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:1.0:1789302109.441710:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789302109.442151:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8843:x1876219121395840:12345-0@lo:700: Request processed in 69649us (72525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.442172:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789302109.443480:0:8843:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc382916680 x1876219121395840/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789302125 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302109.443500:0:8843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382916680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8843:1876219121395840:0@lo:700: 00000040:01000000:2.0:1789302109.446786:0:8845:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789302109.446827:0:8845:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789302109.448414:0:8845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302109.452262:0:8845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302109.452452:0:8845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789302109.452635:0:8845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789302109.454014:0:8847:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302109.454023:0:8847:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789302109.455069:0:8845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789302109.455086:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789302109.455379:0:8845:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789302109.455415:0:8845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd399141 00000100:00080000:0.0:1789302109.455438:0:8845:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789302109.455453:0:8845:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cc4b7e9f000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302109.455506:0:8845:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc381f76300 x1876219121397376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789302109.455538:0:8845:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789302109.455636:0:8845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302109.455641:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302109.455643:0:8845:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789302109.455646:0:8845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302109.455650:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302109.455652:0:8845:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789302109.455654:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789302109.455656:0:8845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789302109.455690:0:8845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8845:1876219121397504:0@lo:502: 00000100:00100000:3.0:1789302109.456300:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302109.456317:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121397632:0@lo:13: 00000100:00100000:3.0:1789302109.456403:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789302109.456483:0:8843:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789302109.456499:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121397632 00000100:00100000:3.0:1789302109.456503:0:8843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8843:1876219121397760:0@lo:7: 00000100:00100000:1.0:1789302109.456509:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121397632 00000100:00100000:3.0:1789302109.456530:0:8843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302109.456544:0:8843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc482ff6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302109.456563:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302109.456575:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121397632:12345-0@lo:13: 00000100:00100000:2.0:1789302109.456633:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121397376:0@lo:8: 00000100:00100000:2.0:1789302109.456667:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.456793:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121397760 00000100:00100000:2.0:1789302109.456799:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121397760 00000100:00100000:2.0:1789302109.456830:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121397376 00000100:00100000:2.0:1789302109.456833:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121397376 00000100:00100000:2.0:1789302109.456843:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302109.456850:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8843:x1876219121397760:12345-0@lo:7: 00002000:00000024:1.0:1789302109.457190:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789302109.457267:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876219121397632:12345-0@lo:13: Request processed in 693us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.457275:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789302109.457328:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f7ce00 x1876219121397632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302109.457366:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121397632:0@lo:13: 00000100:00100000:0.0:1789302109.461653:0:8845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.461719:0:8845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0ab0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.462147:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121397504 00000100:00100000:2.0:1789302109.462160:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121397504 00000100:00100000:2.0:1789302109.462232:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789302109.462243:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4883a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:8845:x1876219121397504:12345-0@lo:502: 00000100:00100000:2.0:1789302109.462414:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4883a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:8845:x1876219121397504:12345-0@lo:502: Request processed in 173us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302109.462441:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789302109.464081:0:8845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:8845:1876219121397504:0@lo:502: 00000020:01000000:0.0:1789302109.464395:0:8845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302109.464410:0:8845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302109.464421:0:8845:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789302109.464436:0:8845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789302109.465513:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789302109.465549:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789302109.465565:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.465580:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302109.465592:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789302109.465596:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cc4ac2ab380 from 1 10000000:01000000:2.0:1789302109.465599:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789302109.465657:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.465666:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.465679:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302109.465709:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121397888:0@lo:101: 00000100:00100000:2.0:1789302109.465880:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.465941:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0462000 going to sleep for 11 seconds 00000100:00100000:3.0:1789302109.466855:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121397888 00000100:00100000:3.0:1789302109.466870:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121397888 00000100:00100000:3.0:1789302109.466936:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789302109.466948:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121397888:12345-0@lo:101: 00010000:00010000:3.0:1789302109.466969:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302109.466999:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166f400/0x1ff82925bd39914f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399148 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302109.467031:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166f400/0x1ff82925bd39914f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399148 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302109.467059:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166f400/0x1ff82925bd39914f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399148 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302109.467070:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f400, rc 0) 00000100:00100000:3.0:1789302109.467162:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121397888:12345-0@lo:101: Request processed in 215us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302109.467170:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789302109.467409:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121397888:0@lo:101: 00010000:00010000:2.0:1789302109.467439:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.467451:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302109.467550:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121398016:0@lo:501: 00000100:00100000:2.0:1789302109.467586:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.467626:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0462000 going to sleep for 11 seconds 00000100:00100000:3.0:1789302109.470477:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121398016 00000100:00100000:3.0:1789302109.470496:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121398016 00000100:00100000:3.0:1789302109.470575:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789302109.470587:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121398016:12345-0@lo:501: 00000100:00100000:3.0:1789302109.470769:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121398016:12345-0@lo:501: Request processed in 183us (3182us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302109.470777:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789302109.471186:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121398016:0@lo:501: 10000000:01000000:2.0:1789302109.471244:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789302109.471257:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302109.471270:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789302109.474696:0:8447:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789302109.474706:0:8447:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789302109.474822:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8843:x1876219121397760:12345-0@lo:7: Request processed in 17966us (18285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.474839:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302109.474884:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302109.474891:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876219121397376:12345-0@lo:8: 00010000:00080000:1.0:1789302109.474926:0:8447:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1789302109.474958:0:8447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd399156 00002000:00100000:1.0:1789302109.474973:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cc381fcc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789302109.474978:0:8447:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789302109.474980:0:8447:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789302109.475021:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789302109.475050:0:8447:0:(import.c:65:import_set_state_nolock()) ffff8cc381fcf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302109.475093:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876219121397376:12345-0@lo:8: Request processed in 201us (18425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.475099:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789302109.475746:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f76300 x1876219121397376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302109.475761:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789302109.475771:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789302109.475783:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789302109.475791:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789302109.475794:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e9f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789302109.475826:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789302109.475832:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121397376:0@lo:8: 00000004:00080000:2.0:1789302109.475870:0:8847:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789302109.475952:0:8847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 185518839054ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789302109.475960:0:8847:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:3.0:1789302109.485951:0:8843:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f7fb80 x1876219121397760/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789302125 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302109.485977:0:8843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8843:1876219121397760:0@lo:7: 00000004:00080000:3.0:1789302109.486000:0:8843:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789302109.486051:0:8843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8843:1876219121398144:0@lo:5: 00000100:00100000:3.0:1789302109.486171:0:8843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302109.486206:0:8843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc482ff6780 going to sleep for 11 seconds 00000100:00100000:3.0:1789302109.486251:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121398144 00000100:00100000:3.0:1789302109.486259:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121398144 00000100:00100000:3.0:1789302109.486317:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302109.486328:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8843:x1876219121398144:12345-0@lo:5: 00002000:00080000:3.0:1789302109.486365:0:8446:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789302109.486416:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8843:x1876219121398144:12345-0@lo:5: Request processed in 90us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302109.486436:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789302109.486470:0:8843:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f7fb80 x1876219121398144/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302125 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302109.486481:0:8843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8843:1876219121398144:0@lo:5: 00000004:00080000:3.0:1789302109.486490:0:8843:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789302109.486514:0:8843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8843:1876219121398272:0@lo:5: 00000100:00100000:3.0:1789302109.486533:0:8843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302109.486547:0:8843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc482ff6780 going to sleep for 11 seconds 00000100:00100000:3.0:1789302109.486557:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121398272 00000100:00100000:3.0:1789302109.486560:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121398272 00000100:00100000:3.0:1789302109.486583:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302109.486588:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8843:x1876219121398272:12345-0@lo:5: 00002000:00080000:3.0:1789302109.486632:0:8446:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000004:00080000:0.0:1789302109.487916:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789302109.491753:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8843:x1876219121398272:12345-0@lo:5: Request processed in 5149us (5204us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789302109.491771:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1789302109.499083:0:8848:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789302109.499172:0:8848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8848:1876219121398528:0@lo:7: 00000100:00100000:2.0:1789302109.499279:0:8848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302109.499327:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121398528 00000100:00100000:3.0:1789302109.499337:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121398528 00000100:00100000:3.0:1789302109.499410:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302109.499432:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8848:x1876219121398528:12345-0@lo:7: 00000100:00100000:1.0:1789302109.499502:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121398400:0@lo:13: 00000100:00100000:1.0:1789302109.499561:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302109.499599:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121398400 00000100:00100000:1.0:1789302109.499603:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121398400 00000100:00100000:1.0:1789302109.499644:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302109.499650:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121398400:12345-0@lo:13: 00002000:00000024:1.0:1789302109.499665:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1789302109.499710:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121398400:12345-0@lo:13: Request processed in 60us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.499718:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302109.499842:0:8848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0462000 going to sleep for 11 seconds 00010000:00080000:1.0:1789302109.500847:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd969880 x1876219121398400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302109.500877:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121398400:0@lo:13: 00010000:00080000:0.0:1789302109.501670:0:8843:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f7fb80 x1876219121398272/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302125 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302109.501687:0:8843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8843:1876219121398272:0@lo:5: 00000004:00080000:0.0:1789302109.501704:0:8843:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789302109.501765:0:8843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8843:1876219121398656:0@lo:900: 00000100:00100000:0.0:1789302109.501827:0:8843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.501864:0:8843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48677c780 going to sleep for 11 seconds 00000100:00080000:0.0:1789302109.502208:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302109.504830:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121398656 00000100:00100000:1.0:1789302109.504854:0:6542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121398656 00000100:00100000:1.0:1789302109.504926:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302109.504936:0:6542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8843:x1876219121398656:12345-0@lo:900: 00000100:00100000:1.0:1789302109.505047:0:6542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8843:x1876219121398656:12345-0@lo:900: Request processed in 113us (3220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.505054:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789302109.505134:0:8843:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f77480 x1876219121398656/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789302125 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302109.505152:0:8843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8843:1876219121398656:0@lo:900: 00002000:00080000:3.0:1789302109.508409:0:8445:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789302109.508421:0:8445:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789302109.508550:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8848:x1876219121398528:12345-0@lo:7: Request processed in 9126us (9267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302109.508562:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789302109.508654:0:8848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd969180 x1876219121398528/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789302125 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302109.508674:0:8848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8848:1876219121398528:0@lo:7: 00000004:00080000:0.0:1789302109.508693:0:8848:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789302109.508739:0:8848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8848:1876219121398784:0@lo:5: 00000100:00100000:0.0:1789302109.508779:0:8848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302109.508818:0:8848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48677c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302109.508990:0:8446:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789302109.509005:0:8446:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789302109.509143:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121398784 00000100:00100000:1.0:1789302109.509150:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121398784 00000100:00100000:1.0:1789302109.513663:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789302109.513685:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8848:x1876219121398784:12345-0@lo:5: 00002000:00080000:1.0:1789302109.513842:0:8446:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789302109.513847:0:8446:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1789302109.526948:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1789302109.526971:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789302109.526976:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789302109.527446:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8848:x1876219121398784:12345-0@lo:5: Request processed in 13766us (18660us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789302109.527461:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789302109.527575:0:8848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f75180 x1876219121398784/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302125 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302109.527589:0:8848:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789302109.527596:0:8848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8848:1876219121398784:0@lo:5: 00000004:00080000:1.0:1789302109.527618:0:8848:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789302109.527683:0:8848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8848:1876219121398912:0@lo:700: 00000100:00100000:1.0:1789302109.527759:0:8848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302109.527808:0:8848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302109.527909:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121398912 00000100:00100000:2.0:1789302109.527919:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121398912 00000100:00100000:2.0:1789302109.527981:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302109.527993:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8848:x1876219121398912:12345-0@lo:700: 00000100:00100000:1.0:1789302109.543338:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8848:x1876219121398912:12345-0@lo:700: Request processed in 15333us (15566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302109.543357:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789302109.543434:0:8848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc382917b80 x1876219121398912/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789302125 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302109.543454:0:8848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8848:1876219121398912:0@lo:700: 00000004:02000040:1.0:1789302109.563898:0:8848:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1789302109.574347:0:8848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8848:1876219121399040:0@lo:5: 00000100:00100000:2.0:1789302109.574451:0:8848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302109.574516:0:8848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0462600 going to sleep for 11 seconds 00000100:00100000:0.0:1789302109.574585:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121399040 00000100:00100000:0.0:1789302109.574595:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121399040 00000100:00100000:0.0:1789302109.574661:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302109.574673:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8848:x1876219121399040:12345-0@lo:5: 00002000:00080000:3.0:1789302109.585352:0:8852:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789302109.585381:0:8852:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00010000:00010000:1.0:1789302109.589800:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302109.604560:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8848:x1876219121399040:12345-0@lo:5: Request processed in 29878us (30098us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789302109.604688:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789302109.613708:0:8848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd969f80 x1876219121399040/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302125 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302109.613748:0:8848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8848:1876219121399040:0@lo:5: 00000004:00080000:2.0:1789302109.613773:0:8848:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:3.0:1789302109.844351:0:8874:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789302109.845526:0:8874:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789302110.616648:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789302111.089457:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1789302111.319877:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121399168:0@lo:41: 00000100:00100000:1.0:1789302111.319947:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302111.320066:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121399168 00000100:00100000:0.0:1789302111.320087:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121399168 00000100:00100000:0.0:1789302111.320162:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789302111.320171:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121399168:12345-0@lo:41: 00000004:00000024:0.0:1789302111.320203:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789302111.320256:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121399168:12345-0@lo:41: Request processed in 86us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302111.320262:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302111.320420:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121399168:0@lo:41: 00010000:00010000:1.0:1789302111.636480:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302112.342596:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121399296:0@lo:41: 00000100:00100000:1.0:1789302112.342682:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302112.342765:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121399296 00000100:00100000:1.0:1789302112.342775:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121399296 00000100:00100000:1.0:1789302112.342827:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789302112.342837:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121399296:12345-0@lo:41: 00000004:00000024:1.0:1789302112.342878:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789302112.342927:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121399296:12345-0@lo:41: Request processed in 90us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302112.342935:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789302112.342981:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121399296:0@lo:41: 00010000:00010000:1.0:1789302112.664635:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789302113.246255:0:8975:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302113.246504:0:8975:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789302113.688036:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789302114.286708:0:9023:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302114.286721:0:9023:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1789302114.708861:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302114.900516:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302114.900552:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121399424:0@lo:13: 00000100:00100000:1.0:1789302114.900642:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302114.900731:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121399424 00000100:00100000:1.0:1789302114.900758:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121399424 00000100:00100000:1.0:1789302114.900826:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302114.900839:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121399424:12345-0@lo:13: 00002000:00000024:1.0:1789302114.900876:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302114.900926:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121399424:12345-0@lo:13: Request processed in 90us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302114.900934:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789302114.900984:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc382917480 x1876219121399424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302114.900996:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789302114.901020:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121399424:0@lo:13: 00000100:00080000:0.0:1789302114.901298:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302114.901308:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302114.901319:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121399552:0@lo:13: 00000100:00100000:0.0:1789302114.901355:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302114.901404:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121399552 00000100:00100000:0.0:1789302114.901409:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121399552 00000100:00100000:0.0:1789302114.901443:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302114.901450:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121399552:12345-0@lo:13: 00002000:00000024:0.0:1789302114.901464:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302114.901497:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121399552:12345-0@lo:13: Request processed in 48us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302114.901504:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789302114.901519:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302114.901535:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f76300 x1876219121399552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302114.901544:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789302114.901558:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121399552:0@lo:13: 00000100:00100000:2.0:1789302114.901789:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121399936:0@lo:400: 00000100:00100000:2.0:1789302114.901825:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302114.901848:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd96a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121400448:0@lo:400: 00000100:00100000:2.0:1789302114.901873:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302114.901893:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789302114.901899:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121399808:0@lo:400: 00000100:00100000:2.0:1789302114.901921:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302114.901938:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121400320:0@lo:400: 00000100:00100000:2.0:1789302114.901956:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302114.901996:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121399936 00000100:00100000:2.0:1789302114.902000:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121399936 00000100:00100000:2.0:1789302114.902036:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302114.902043:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121399936:12345-0@lo:400: 00000100:00100000:2.0:1789302114.902086:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121399936:12345-0@lo:400: Request processed in 43us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302114.902091:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302114.902152:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121400448 00000100:00100000:2.0:1789302114.902156:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121400448 00000100:00100000:2.0:1789302114.902189:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121399808 00000100:00100000:2.0:1789302114.902191:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121399808 00000100:00100000:2.0:1789302114.902203:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121400320 00000100:00100000:2.0:1789302114.902206:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121400320 00000100:00100000:2.0:1789302114.902219:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789302114.902240:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121400448:12345-0@lo:400: 00000100:00100000:2.0:1789302114.902273:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121400448:12345-0@lo:400: Request processed in 33us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302114.902279:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789302114.902291:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789302114.902298:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121399808:12345-0@lo:400: 00000100:00100000:2.0:1789302114.902324:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121399808:12345-0@lo:400: Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302114.902330:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789302114.902340:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789302114.902347:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121400320:12345-0@lo:400: 00000100:00100000:2.0:1789302114.902373:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121400320:12345-0@lo:400: Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302114.902379:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789302114.902428:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302114.902431:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789302114.902456:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd968700 x1876219121399808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302114.902468:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121399808:0@lo:400: 00010000:00080000:2.0:1789302114.902494:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd968a80 x1876219121400320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302114.902502:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121400320:0@lo:400: 00000100:00100000:2.0:1789302114.902511:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121399936:0@lo:400: 00010000:00080000:2.0:1789302114.902520:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd96a680 x1876219121400448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302114.902528:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd96a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121400448:0@lo:400: 00000100:00100000:0.0:1789302114.902927:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121399680:0@lo:400: 00000100:00100000:0.0:1789302114.902981:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302114.903029:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd96ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121400192:0@lo:400: 00000100:00100000:0.0:1789302114.903056:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302114.903097:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302114.903103:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd96b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121400064:0@lo:400: 00000100:00100000:0.0:1789302114.903164:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302114.903197:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121400064 00000100:00100000:0.0:1789302114.903205:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121400064 00000100:00100000:0.0:1789302114.903254:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789302114.903264:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121400064:12345-0@lo:400: 00000100:00100000:0.0:1789302114.903321:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121400064:12345-0@lo:400: Request processed in 57us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302114.903328:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789302114.903379:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd96b100 x1876219121400064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302114.903400:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd96b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121400064:0@lo:400: 00000100:00100000:3.0:1789302114.903548:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121400192 00000100:00100000:3.0:1789302114.903555:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121400192 00000100:00100000:3.0:1789302114.903599:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302114.903607:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121400192:12345-0@lo:400: 00000100:00100000:3.0:1789302114.903659:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121400192:12345-0@lo:400: Request processed in 52us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302114.903665:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302114.903691:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd96ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121400192:0@lo:400: 00000100:00100000:2.0:1789302114.906167:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121399680 00000100:00100000:2.0:1789302114.906190:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121399680 00000100:00100000:2.0:1789302114.906289:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789302114.906303:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:3648:x1876219121399680:12345-0@lo:400: 00000100:00100000:2.0:1789302114.906451:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:3648:x1876219121399680:12345-0@lo:400: Request processed in 151us (3468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302114.906459:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789302114.906656:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121399680:0@lo:400: 00010000:00010000:1.0:1789302115.743313:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302116.449651:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302116.449686:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121400576:0@lo:41: 00000100:00100000:0.0:1789302116.449776:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302116.450024:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121400576 00000100:00100000:2.0:1789302116.450035:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121400576 00000100:00100000:2.0:1789302116.450278:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789302116.450292:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121400576:12345-0@lo:41: 00000004:00000024:2.0:1789302116.450337:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789302116.450717:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121400576:12345-0@lo:41: Request processed in 426us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302116.451565:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789302116.452241:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121400576:0@lo:41: 00010000:00010000:3.0:1789302116.756939:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302117.465210:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121400704:0@lo:41: 00000100:00100000:2.0:1789302117.465323:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302117.465425:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121400704 00000100:00100000:2.0:1789302117.465436:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121400704 00000100:00100000:2.0:1789302117.465501:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789302117.465513:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121400704:12345-0@lo:41: 00000004:00000024:2.0:1789302117.465557:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789302117.465629:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121400704:12345-0@lo:41: Request processed in 119us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302117.465637:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789302117.465956:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121400704:0@lo:41: 00010000:00010000:1.0:1789302117.782090:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302118.808616:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302119.829867:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302120.021274:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302120.021299:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121400832:0@lo:13: 00000100:00100000:1.0:1789302120.021378:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302120.021443:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121400832 00000100:00100000:1.0:1789302120.021451:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121400832 00000100:00100000:1.0:1789302120.021510:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789302120.021520:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121400832:12345-0@lo:13: 00002000:00000024:1.0:1789302120.021551:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302120.021595:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121400832:12345-0@lo:13: Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302120.021602:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789302120.021622:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789302120.021654:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc382917480 x1876219121400832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302120.021690:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121400832:0@lo:13: 00000100:00100000:3.0:1789302120.025721:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121401344:0@lo:400: 00000100:00100000:3.0:1789302120.025797:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302120.025832:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121401856:0@lo:400: 00000100:00100000:3.0:1789302120.025856:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302120.025886:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789302120.025893:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121400960:0@lo:400: 00000100:00100000:3.0:1789302120.025919:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302120.025951:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121401472:0@lo:400: 00000100:00100000:3.0:1789302120.025976:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302120.026005:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121401088:0@lo:400: 00000100:00100000:3.0:1789302120.026028:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302120.026047:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121401600:0@lo:400: 00000100:00100000:3.0:1789302120.026071:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302120.026090:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789302120.026095:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121401216:0@lo:400: 00000100:00100000:3.0:1789302120.026133:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302120.026152:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121401728:0@lo:400: 00000100:00100000:3.0:1789302120.026171:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302120.026195:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121401344 00000100:00100000:3.0:1789302120.026202:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121401344 00000100:00100000:3.0:1789302120.026261:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121401088 00000100:00100000:3.0:1789302120.026265:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121401088 00000100:00100000:3.0:1789302120.026278:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121401600 00000100:00100000:3.0:1789302120.026280:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121401600 00000100:00100000:3.0:1789302120.026305:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121401728 00000100:00100000:3.0:1789302120.026308:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121401728 00000100:00100000:3.0:1789302120.026325:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789302120.026333:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121401344:12345-0@lo:400: 00000100:00100000:3.0:1789302120.026388:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121401344:12345-0@lo:400: Request processed in 56us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302120.026395:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789302120.026412:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789302120.026418:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121401088:12345-0@lo:400: 00000100:00100000:3.0:1789302120.026447:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121401088:12345-0@lo:400: Request processed in 30us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302120.026459:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789302120.026472:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789302120.026478:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121401600:12345-0@lo:400: 00000100:00100000:3.0:1789302120.026505:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121401600:12345-0@lo:400: Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302120.026510:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789302120.026521:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789302120.026527:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121401728:12345-0@lo:400: 00000100:00100000:3.0:1789302120.026550:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121401728:12345-0@lo:400: Request processed in 24us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302120.026555:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789302120.026572:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121401472 00000100:00100000:3.0:1789302120.026575:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121401472 00000100:00100000:3.0:1789302120.026596:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121401216 00000100:00100000:3.0:1789302120.026599:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121401216 00000100:00100000:3.0:1789302120.026610:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789302120.026616:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121401472:12345-0@lo:400: 00000100:00100000:3.0:1789302120.026646:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121401472:12345-0@lo:400: Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302120.026652:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789302120.026663:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789302120.026669:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121401216:12345-0@lo:400: 00000100:00100000:3.0:1789302120.026693:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121401216:12345-0@lo:400: Request processed in 25us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302120.026699:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789302120.026727:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789302120.026736:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302120.027892:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121401856 00000100:00100000:2.0:1789302120.027901:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121401856 00000100:00100000:2.0:1789302120.027954:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302120.027964:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121401856:12345-0@lo:400: 00000100:00100000:2.0:1789302120.028017:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121401856:12345-0@lo:400: Request processed in 55us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302120.028023:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789302120.028053:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302120.028101:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121401216:0@lo:400: 00010000:00080000:2.0:1789302120.028131:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b5281f80 x1876219121401728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302120.028142:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121401728:0@lo:400: 00010000:00080000:2.0:1789302120.028154:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc382915f80 x1876219121401088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302120.028175:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121401088:0@lo:400: 00010000:00080000:2.0:1789302120.028189:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc382917800 x1876219121401600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302120.028197:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121401600:0@lo:400: 00000100:00100000:2.0:1789302120.028233:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121401472:0@lo:400: 00010000:00080000:2.0:1789302120.028244:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc382916a00 x1876219121401344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302120.028252:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121401344:0@lo:400: 00010000:00080000:2.0:1789302120.028267:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b5283100 x1876219121401856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302120.028275:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121401856:0@lo:400: 00000100:00100000:2.0:1789302120.028324:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121400960 00000100:00100000:2.0:1789302120.028329:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121400960 00000100:00100000:2.0:1789302120.028367:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789302120.028374:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:3645:x1876219121400960:12345-0@lo:400: 00000100:00100000:2.0:1789302120.028409:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:3645:x1876219121400960:12345-0@lo:400: Request processed in 37us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302120.028415:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789302120.028453:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121400960:0@lo:400: 00000100:00100000:2.0:1789302120.036975:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121401984:0@lo:13: 00000100:00100000:2.0:1789302120.037055:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302120.037129:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121401984 00000100:00100000:2.0:1789302120.037142:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121401984 00000100:00100000:2.0:1789302120.037190:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302120.037199:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121401984:12345-0@lo:13: 00002000:00000024:2.0:1789302120.037234:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302120.037292:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121401984:12345-0@lo:13: Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302120.037299:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789302120.037343:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd969c00 x1876219121401984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302120.037369:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121401984:0@lo:13: 00010000:00010000:3.0:1789302120.853651:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302121.573715:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121402112:0@lo:41: 00000100:00100000:1.0:1789302121.573828:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302121.573941:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121402112 00000100:00100000:3.0:1789302121.573953:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121402112 00000100:00100000:3.0:1789302121.574015:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789302121.574038:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121402112:12345-0@lo:41: 00000004:00000024:3.0:1789302121.574082:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789302121.576576:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121402112:12345-0@lo:41: Request processed in 2528us (2737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302121.576592:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789302121.576693:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121402112:0@lo:41: 00010000:00010000:1.0:1789302121.877144:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302122.584286:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121402240:0@lo:41: 00000100:00100000:1.0:1789302122.584370:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302122.584441:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121402240 00000100:00100000:1.0:1789302122.584448:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121402240 00000100:00100000:1.0:1789302122.584492:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789302122.584502:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121402240:12345-0@lo:41: 00000004:00000024:1.0:1789302122.584535:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789302122.584578:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121402240:12345-0@lo:41: Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302122.584585:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789302122.584626:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121402240:0@lo:41: 00010000:00010000:2.0:1789302122.904080:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302123.928061:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302124.948408:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302125.141801:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121402368:0@lo:13: 00000100:00100000:1.0:1789302125.141901:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302125.142002:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121402368 00000100:00100000:1.0:1789302125.142012:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121402368 00000100:00100000:1.0:1789302125.142080:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789302125.142093:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121402368:12345-0@lo:13: 00002000:00000024:1.0:1789302125.142152:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302125.142226:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121402368:12345-0@lo:13: Request processed in 136us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302125.142234:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789302125.142258:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789302125.142296:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b5280e00 x1876219121402368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302125.142334:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121402368:0@lo:13: 00000100:00100000:1.0:1789302125.148070:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121402496:0@lo:400: 00000100:00100000:1.0:1789302125.148189:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302125.148238:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121403008:0@lo:400: 00000100:00100000:1.0:1789302125.148269:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302125.148299:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121403520:0@lo:13: 00000100:00100000:1.0:1789302125.148367:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302125.148403:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789302125.148411:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121402880:0@lo:400: 00000100:00100000:1.0:1789302125.148440:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302125.148459:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121403392:0@lo:400: 00000100:00100000:1.0:1789302125.148497:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302125.148529:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121402624:0@lo:400: 00000100:00100000:1.0:1789302125.148683:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302125.148702:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121403136:0@lo:400: 00000100:00100000:1.0:1789302125.148724:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302125.148742:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789302125.148749:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121402752:0@lo:400: 00000100:00100000:1.0:1789302125.148769:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302125.148796:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121403264:0@lo:400: 00000100:00100000:1.0:1789302125.148818:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302125.148851:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121403008 00000100:00100000:1.0:1789302125.148861:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121403008 00000100:00100000:3.0:1789302125.149006:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121402496 00000100:00100000:3.0:1789302125.149012:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121402496 00000100:00100000:3.0:1789302125.149059:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789302125.149069:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:3646:x1876219121402496:12345-0@lo:400: 00000100:00100000:3.0:1789302125.149158:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:3646:x1876219121402496:12345-0@lo:400: Request processed in 89us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302125.149166:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789302125.149205:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121403392 00000100:00100000:3.0:1789302125.149209:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121403392 00000100:00100000:3.0:1789302125.149258:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302125.149265:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121403392:12345-0@lo:400: 00000100:00100000:3.0:1789302125.149296:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121403392:12345-0@lo:400: Request processed in 32us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302125.149301:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302125.149329:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121402880 00000100:00100000:3.0:1789302125.149333:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121402880 00000100:00100000:3.0:1789302125.149350:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121402624 00000100:00100000:3.0:1789302125.149352:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121402624 00000100:00100000:3.0:1789302125.149361:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121403136 00000100:00100000:3.0:1789302125.149370:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121403136 00000100:00100000:3.0:1789302125.149384:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121403264 00000100:00100000:3.0:1789302125.149386:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121403264 00000100:00100000:3.0:1789302125.149399:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789302125.149405:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121402880:12345-0@lo:400: 00000100:00100000:3.0:1789302125.149435:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121402880:12345-0@lo:400: Request processed in 31us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302125.149441:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789302125.149452:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789302125.149457:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121402624:12345-0@lo:400: 00000100:00100000:3.0:1789302125.149502:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121402624:12345-0@lo:400: Request processed in 44us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302125.149508:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789302125.149518:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789302125.149523:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121403136:12345-0@lo:400: 00000100:00100000:3.0:1789302125.149665:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121403136:12345-0@lo:400: Request processed in 141us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302125.149672:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789302125.149684:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302125.149691:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121403264:12345-0@lo:400: 00000100:00100000:3.0:1789302125.149719:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121403264:12345-0@lo:400: Request processed in 29us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302125.149725:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789302125.149747:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789302125.149752:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302125.149755:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302125.149976:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc485dd1880 x1876219121403264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302125.149999:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121403264:0@lo:400: 00010000:00080000:3.0:1789302125.150011:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f7d180 x1876219121402624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302125.150020:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121402624:0@lo:400: 00010000:00080000:3.0:1789302125.150028:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc485dd1f80 x1876219121403136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302125.150036:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121403136:0@lo:400: 00010000:00080000:3.0:1789302125.150069:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f7fb80 x1876219121402880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302125.150077:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121402880:0@lo:400: 00010000:00080000:3.0:1789302125.150086:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc485dd1c00 x1876219121403392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302125.150094:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121403392:0@lo:400: 00000100:00100000:3.0:1789302125.150102:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121402496:0@lo:400: 00000100:00100000:1.0:1789302125.150614:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121402752 00000100:00100000:1.0:1789302125.150620:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121402752 00000100:00100000:1.0:1789302125.150643:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789302125.150650:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121403008:12345-0@lo:400: 00000100:00100000:1.0:1789302125.150700:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121403008:12345-0@lo:400: Request processed in 51us (2430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302125.150706:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789302125.150718:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789302125.150723:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121402752:12345-0@lo:400: 00000100:00100000:1.0:1789302125.150748:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121402752:12345-0@lo:400: Request processed in 26us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302125.150753:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789302125.150780:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121403520 00000100:00100000:1.0:1789302125.150783:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121403520 00000100:00100000:1.0:1789302125.150804:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302125.150810:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121403520:12345-0@lo:13: 00002000:00000024:1.0:1789302125.150825:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302125.150852:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121403520:12345-0@lo:13: Request processed in 43us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302125.150858:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302125.152844:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121402752:0@lo:400: 00000100:00100000:1.0:1789302125.152927:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121403008:0@lo:400: 00010000:00080000:1.0:1789302125.152944:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc485dd3480 x1876219121403520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302125.152979:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121403520:0@lo:13: 00010000:00010000:2.0:1789302125.981654:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302126.677371:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121403648:0@lo:41: 00000100:00100000:2.0:1789302126.677476:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302126.678436:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121403648 00000100:00100000:1.0:1789302126.678451:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121403648 00000100:00100000:1.0:1789302126.678534:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789302126.678546:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121403648:12345-0@lo:41: 00000004:00000024:1.0:1789302126.678593:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789302126.678665:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121403648:12345-0@lo:41: Request processed in 121us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302126.678673:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789302126.678881:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121403648:0@lo:41: 00000020:01000004:3.0:1789302126.939923:0:9523:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789302126.939929:0:9523:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789302126.939930:0:9523:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789302126.940089:0:9523:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cc382b0f800 00000020:01000004:3.0:1789302126.940152:0:9523:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789302126.940170:0:9523:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789302126.940189:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cc38262cd40) 00000020:00000080:3.0:1789302126.940211:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1789302126.997023:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789302127.053389:0:9523:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789302127.053660:0:9523:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1789302127.120045:0:9523:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789302127.120751:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789302127.120769:0:9523:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789302127.120783:0:9523:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1ff82925bd399164 00000020:01000004:1.0:1789302127.120792:0:9523:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789302127.120822:0:9523:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.109@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789302127.120826:0:9523:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789302127.120833:0:9523:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789302127.120869:0:9523:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789302127.120874:0:9523:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789302127.175796:0:9523:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.109@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789302127.175852:0:9523:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.109@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1789302127.175857:0:9523:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789302127.175859:0:9523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789302127.175860:0:9523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302127.175862:0:9523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302127.175864:0:9523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302127.175865:0:9523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302127.175866:0:9523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789302127.175868:0:9523:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302127.175870:0:9523:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302127.175872:0:9523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302127.175873:0:9523:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789302127.175877:0:9523:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1789302127.175880:0:9523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789302127.175881:0:9523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789302127.175882:0:9523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302127.175884:0:9523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302127.175885:0:9523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302127.175886:0:9523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302127.175887:0:9523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789302127.175888:0:9523:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302127.175889:0:9523:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302127.175890:0:9523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302127.175891:0:9523:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789302127.175925:0:9523:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789302127.175949:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121403776:0@lo:253: 00000100:00100000:0.0:1789302127.176104:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.176536:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121403776 00000100:00100000:2.0:1789302127.176614:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121403776 00000100:00100000:2.0:1789302127.176726:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789302127.176738:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:9523:x1876219121403776:12345-0@lo:253: 20000000:01000000:2.0:1789302127.176797:0:6525:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789302127.176802:0:6525:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789302127.176808:0:6525:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789302127.176811:0:6525:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789302127.177109:0:6525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302127.177333:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1789302127.177350:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789302127.177369:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1789302127.177375:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789302127.177388:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1789302127.177403:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1789302127.177512:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1789302127.177529:0:6525:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.109@tcp 20000000:01000000:2.0:1789302127.177531:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.109@tcp (null) (null) (null) 00000040:00080000:2.0:1789302127.177559:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1789302127.177566:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789302127.177581:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1789302127.177588:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.109@tcp (null) (null) 00000040:00080000:2.0:1789302127.177601:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1789302127.177609:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789302127.177623:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1789302127.177639:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1789302127.177718:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1789302127.177729:0:6525:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.109@tcp 20000000:01000000:2.0:1789302127.177731:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.109@tcp (null) (null) (null) 00000040:00080000:2.0:1789302127.177745:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1789302127.177751:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789302127.177765:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1789302127.177771:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.109@tcp (null) (null) 00000040:00080000:2.0:1789302127.177784:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1789302127.177790:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789302127.177801:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1789302127.177815:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1789302127.178209:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1789302127.178222:0:6525:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.109@tcp 20000000:01000000:2.0:1789302127.178224:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.109@tcp (null) (null) (null) 00000040:00080000:2.0:1789302127.178253:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1789302127.178260:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789302127.178273:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1789302127.178279:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.109@tcp (null) (null) 00000040:00080000:2.0:1789302127.178291:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1789302127.178297:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789302127.178325:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1789302127.178342:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1789302127.178356:0:6525:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789302127.178359:0:6525:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789302127.178364:0:6525:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789302127.178418:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789302127.178421:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000100:00100000:0.0:1789302127.178580:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3828cb900 going to sleep for 11 seconds 20000000:01000000:0.0:1789302127.179769:0:9529:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1789302127.180807:0:9529:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1789302127.182131:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789302127.182938:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789302127.182973:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789302127.183513:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1789302127.183534:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789302127.183537:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789302127.184606:0:9530:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789302127.184645:0:9530:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789302127.184662:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1789302127.188508:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1789302127.188568:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1789302127.188585:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1789302127.188609:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789302127.188613:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789302127.189708:0:9531:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1789302127.189745:0:9531:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1789302127.189776:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1789302127.190275:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1789302127.190309:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1789302127.190327:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1789302127.190338:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789302127.190341:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789302127.190889:0:9532:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1789302127.190910:0:9532:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1789302127.190925:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1789302127.191637:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1789302127.191661:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1789302127.191698:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1789302127.191710:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789302127.191712:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789302127.192430:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1789302127.192654:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1789302127.192677:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1789302127.192692:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:2.0:1789302127.192712:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789302127.192739:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.192760:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd399061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39905a expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.192768:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39908b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399084 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.192776:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b538e600/0x1ff82925bd3990ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3990c3 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.192784:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4c2179c00/0x1ff82925bd3990e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3990df expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.192792:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa983800/0x1ff82925bd399110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399109 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.192799:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39912c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399125 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.192807:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48166f400/0x1ff82925bd39914f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399148 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.192814:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.192862:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48166f400/0x1ff82925bd39914f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399148 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.192887:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc48166f400/0x1ff82925bd39914f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399148 expref: 21 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.192909:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd968700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121403904:0@lo:104: 00000100:00100000:2.0:1789302127.193000:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302127.193063:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39912c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399125 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.193072:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39912c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399125 expref: 21 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.193080:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404032:0@lo:104: 00000100:00100000:2.0:1789302127.193102:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302127.193166:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa983800/0x1ff82925bd399110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399109 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.193174:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4aa983800/0x1ff82925bd399110 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399109 expref: 21 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.193183:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd96ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404160:0@lo:104: 00000100:00100000:2.0:1789302127.193204:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302127.193231:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4c2179c00/0x1ff82925bd3990e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd3990df expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.193239:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4c2179c00/0x1ff82925bd3990e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd3990df expref: 21 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.193248:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404288:0@lo:104: 00000100:00100000:2.0:1789302127.193273:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302127.193289:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b538e600/0x1ff82925bd3990ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd3990c3 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.193297:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4b538e600/0x1ff82925bd3990ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd3990c3 expref: 21 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.193314:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404416:0@lo:104: 00000100:00100000:2.0:1789302127.193334:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302127.193350:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39908b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399084 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.193358:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39908b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399084 expref: 21 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.193366:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382916a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404544:0@lo:104: 00000100:00100000:2.0:1789302127.193386:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302127.193401:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd399061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39905a expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.193409:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd399061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39905a expref: 21 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.193416:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382914380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404672:0@lo:104: 00000100:00100000:2.0:1789302127.193562:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302127.193788:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789302127.193808:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302127.193826:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121403904 00000100:00100000:3.0:1789302127.193835:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121403904 00000100:00100000:3.0:1789302127.193875:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121404032 00000100:00100000:3.0:1789302127.193879:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121404032 00000100:00100000:3.0:1789302127.193890:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121404160 00000100:00100000:3.0:1789302127.193892:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121404160 00000100:00100000:3.0:1789302127.193903:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121404288 00000100:00100000:3.0:1789302127.193905:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121404288 00000100:00100000:3.0:1789302127.193913:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121404416 00000100:00100000:3.0:1789302127.193916:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121404416 00000100:00100000:3.0:1789302127.193924:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121404544 00000100:00100000:3.0:1789302127.193926:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121404544 00000100:00100000:3.0:1789302127.193935:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121404672 00000100:00100000:3.0:1789302127.193937:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121404672 00000100:00100000:3.0:1789302127.193951:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789302127.193960:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+9:6525:x1876219121403904:12345-0@lo:104: 00010000:00010000:3.0:1789302127.193975:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.194047:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302127.194054:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+9:6525:x1876219121403904:12345-0@lo:104: Request processed in 95us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302127.194061:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789302127.194082:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789302127.194088:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+8:6525:x1876219121404032:12345-0@lo:104: 00010000:00010000:3.0:1789302127.194096:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.194151:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789302127.194156:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+8:6525:x1876219121404032:12345-0@lo:104: Request processed in 70us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302127.194172:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789302127.194186:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789302127.194191:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+7:6525:x1876219121404160:12345-0@lo:104: 00010000:00010000:3.0:1789302127.194199:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194296:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302127.194311:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194319:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983c00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302127.194324:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194333:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302127.194348:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302127.194355:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302127.194393:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194401:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302127.194419:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194426:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd399148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39914f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194439:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302127.194442:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194457:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982000 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302127.194460:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194468:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302127.194473:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302127.194478:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302127.194500:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194507:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302127.194523:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194530:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd399125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39912c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194540:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302127.194542:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302127.194544:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302127.194568:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121404928:0@lo:103: 00000100:00100000:1.0:1789302127.194606:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.194659:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121404928 00000100:00100000:1.0:1789302127.194664:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121404928 00010000:00010000:1.0:1789302127.194686:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39912c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399125 expref: 22 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302127.194708:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789302127.194714:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+22:3645:x1876219121404928:12345-0@lo:103: 00010000:00010000:1.0:1789302127.194726:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302127.194732:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39912c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399125 expref: 22 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194741:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39912c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399125 expref: 22 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.194759:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302127.194792:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+22:3645:x1876219121404928:12345-0@lo:103: Request processed in 78us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.194799:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789302127.194840:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121404928:0@lo:103: 00010000:00010000:3.0:1789302127.195066:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302127.195073:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+7:6525:x1876219121404160:12345-0@lo:104: Request processed in 881us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302127.195080:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789302127.195096:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789302127.195103:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd969180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+6:6525:x1876219121404288:12345-0@lo:104: 00010000:00010000:3.0:1789302127.195140:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.195172:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789302127.195177:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd969180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+6:6525:x1876219121404288:12345-0@lo:104: Request processed in 76us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302127.195182:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789302127.195194:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302127.195199:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:6525:x1876219121404416:12345-0@lo:104: 00010000:00010000:3.0:1789302127.195207:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.195313:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789302127.195319:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:6525:x1876219121404416:12345-0@lo:104: Request processed in 119us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302127.195330:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302127.195344:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789302127.195350:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3828d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:6525:x1876219121404544:12345-0@lo:104: 00010000:00010000:3.0:1789302127.195358:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.195384:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789302127.195389:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3828d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:6525:x1876219121404544:12345-0@lo:104: Request processed in 40us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302127.195394:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789302127.195427:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789302127.195433:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:6525:x1876219121404672:12345-0@lo:104: 00010000:00010000:3.0:1789302127.195441:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.195617:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789302127.195622:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:6525:x1876219121404672:12345-0@lo:104: Request processed in 190us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302127.195628:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789302127.195778:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789302127.195785:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.195793:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983200 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302127.195805:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.195813:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302127.195820:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302127.195826:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302127.195863:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.195869:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302127.195895:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.195902:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983200/0x1ff82925bd399109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399110 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.195915:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789302127.195917:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.195923:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2179a00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302127.195925:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.195931:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302127.195948:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302127.195954:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302127.195969:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.195975:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302127.195981:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196000:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179a00/0x1ff82925bd3990df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3990e6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196011:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789302127.196014:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196020:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538fe00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302127.196023:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196029:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302127.196036:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302127.196042:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302127.196061:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196067:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302127.196071:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196078:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3990c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3990ca expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196086:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302127.196089:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196095:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983400 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302127.196099:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196106:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302127.196145:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302127.196150:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302127.196162:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196168:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302127.196173:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196190:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983400/0x1ff82925bd399084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39908b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196199:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302127.196202:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196209:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178400 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302127.196392:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196401:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302127.196407:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302127.196412:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302127.196488:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196496:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302127.196501:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196508:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178400/0x1ff82925bd39905a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399061 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196525:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302127.196541:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302127.196542:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302127.196569:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121404800:0@lo:103: 00000100:00100000:2.0:1789302127.196614:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.196649:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121405312:0@lo:103: 00000100:00100000:2.0:1789302127.196671:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.196694:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302127.196700:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121405184:0@lo:103: 00000100:00100000:2.0:1789302127.196723:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.196757:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121404800 00000100:00100000:2.0:1789302127.196764:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121404800 00010000:00010000:2.0:1789302127.196793:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48166f400/0x1ff82925bd39914f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399148 expref: 22 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.196811:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121405312 00000100:00100000:2.0:1789302127.196814:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121405312 00010000:00010000:2.0:1789302127.196826:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b538e600/0x1ff82925bd3990ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3990c3 expref: 23 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.196836:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121405184 00000100:00100000:2.0:1789302127.196839:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121405184 00010000:00010000:2.0:1789302127.196849:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4c2179c00/0x1ff82925bd3990e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3990df expref: 24 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.196862:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302127.196871:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121404800:12345-0@lo:103: 00010000:00010000:2.0:1789302127.196882:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302127.196887:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48166f400/0x1ff82925bd39914f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399148 expref: 24 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196909:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48166f400/0x1ff82925bd39914f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399148 expref: 24 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.196927:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302127.196960:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121404800:12345-0@lo:103: Request processed in 90us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.196967:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302127.196994:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789302127.197002:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+23:3648:x1876219121405312:12345-0@lo:103: 00010000:00010000:2.0:1789302127.197010:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302127.197015:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b538e600/0x1ff82925bd3990ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3990c3 expref: 23 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197024:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b538e600/0x1ff82925bd3990ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd3990c3 expref: 23 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197034:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302127.197055:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+23:3648:x1876219121405312:12345-0@lo:103: Request processed in 54us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.197061:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789302127.197074:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302127.197081:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48acb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+22:3648:x1876219121405184:12345-0@lo:103: 00010000:00010000:2.0:1789302127.197088:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302127.197092:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4c2179c00/0x1ff82925bd3990e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3990df expref: 22 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197100:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4c2179c00/0x1ff82925bd3990e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd3990df expref: 22 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197134:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302127.197157:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48acb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+22:3648:x1876219121405184:12345-0@lo:103: Request processed in 78us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.197164:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302127.197225:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121405440:0@lo:103: 00000100:00100000:2.0:1789302127.197262:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.197281:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789302127.197287:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121405056:0@lo:103: 00000100:00100000:2.0:1789302127.197314:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.197329:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121405568:0@lo:103: 00000100:00100000:2.0:1789302127.197346:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.197365:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121405440 00000100:00100000:2.0:1789302127.197369:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121405440 00010000:00010000:2.0:1789302127.197384:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39908b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399084 expref: 22 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.197397:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121405056 00000100:00100000:2.0:1789302127.197399:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121405056 00010000:00010000:2.0:1789302127.197409:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa983800/0x1ff82925bd399110 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399109 expref: 23 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.197419:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121405568 00000100:00100000:2.0:1789302127.197421:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121405568 00010000:00010000:2.0:1789302127.197430:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd399061 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39905a expref: 24 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.197440:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789302127.197445:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121405440:12345-0@lo:103: 00010000:00010000:2.0:1789302127.197458:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302127.197462:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39908b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399084 expref: 24 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197470:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39908b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399084 expref: 24 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197479:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302127.197510:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121405440:12345-0@lo:103: Request processed in 64us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.197516:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789302127.197528:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789302127.197534:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+23:3645:x1876219121405056:12345-0@lo:103: 00010000:00010000:2.0:1789302127.197541:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302127.197546:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa983800/0x1ff82925bd399110 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399109 expref: 23 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197553:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa983800/0x1ff82925bd399110 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399109 expref: 23 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197562:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302127.197582:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+23:3645:x1876219121405056:12345-0@lo:103: Request processed in 48us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.197588:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789302127.197612:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789302127.197618:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+22:3645:x1876219121405568:12345-0@lo:103: 00010000:00010000:2.0:1789302127.197625:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302127.197629:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd399061 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39905a expref: 22 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197643:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd399061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39905a expref: 22 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197656:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197665:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197682:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197690:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197697:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197704:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197710:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983600 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302127.197715:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197723:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197732:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.197754:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302127.197776:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+22:3645:x1876219121405568:12345-0@lo:103: Request processed in 158us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.197781:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789302127.197821:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121405184:0@lo:103: 00000100:00100000:2.0:1789302127.197831:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121404800:0@lo:103: 00000100:00100000:2.0:1789302127.197840:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121405312:0@lo:103: 00000100:00100000:2.0:1789302127.197868:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121405056:0@lo:103: 00000100:00100000:2.0:1789302127.197876:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121405568:0@lo:103: 00000100:00100000:2.0:1789302127.197882:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121405440:0@lo:103: 00010000:00010000:2.0:1789302127.197911:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166f400/0x1ff82925bd39914f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399148 expref: 21 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.197926:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd968700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121403904:0@lo:104: 00010000:00010000:2.0:1789302127.197937:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39912c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399125 expref: 20 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.197946:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404032:0@lo:104: 00010000:00010000:2.0:1789302127.197955:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa983800/0x1ff82925bd399110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399109 expref: 19 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.197962:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd96ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404160:0@lo:104: 00010000:00010000:2.0:1789302127.197972:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2179c00/0x1ff82925bd3990e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd3990df expref: 18 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.197988:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404288:0@lo:104: 00010000:00010000:2.0:1789302127.198000:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538e600/0x1ff82925bd3990ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd3990c3 expref: 17 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.198008:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404416:0@lo:104: 00010000:00010000:2.0:1789302127.198017:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39908b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399084 expref: 16 pid: 6524 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.198024:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382916a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404544:0@lo:104: 00010000:00010000:2.0:1789302127.198033:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd399061 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39905a expref: 15 pid: 6525 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.198042:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382914380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6525:1876219121404672:0@lo:104: 00010000:00010000:2.0:1789302127.198068:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.198078:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.198086:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.198092:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39916b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789302127.198107:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1789302127.198976:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302127.198997:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302127.204430:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+14:9523:x1876219121403776:12345-0@lo:253: Request processed in 27682us (28314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302127.204592:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121403776:0@lo:253: 10000000:01000000:3.0:1789302127.204615:0:9523:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789302127.204619:0:9523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789302127.204620:0:9523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789302127.204622:0:9523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302127.204623:0:9523:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789302127.204625:0:9523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302127.204626:0:9523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302127.204628:0:9523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302127.204637:0:9523:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789302127.204639:0:9523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302127.204640:0:9523:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789302127.204665:0:9523:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cc382b0f800 from lustre-OST0001 10000000:01000000:3.0:1789302127.204703:0:9523:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789302127.204706:0:9523:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789302127.204717:0:9523:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cc4ac2ab380 local copy 10000000:01000000:3.0:1789302127.204722:0:9523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789302127.204768:0:9523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.204781:0:9523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.204792:0:9523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302127.204813:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121405696:0@lo:101: 00000100:00100000:3.0:1789302127.204853:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302127.204905:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc490b97d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302127.204969:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121405696 00000100:00100000:1.0:1789302127.204990:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121405696 00000100:00100000:1.0:1789302127.205037:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789302127.205046:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:9523:x1876219121405696:12345-0@lo:101: 00010000:00010000:1.0:1789302127.205061:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302127.205075:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd399179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399172 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.205102:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd399179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399172 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.205134:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd399179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399172 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.205145:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178200, rc 0) 00000100:00100000:1.0:1789302127.205176:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121405696:12345-0@lo:101: Request processed in 131us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.205183:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789302127.205481:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121405696:0@lo:101: 00010000:00010000:3.0:1789302127.205495:0:9523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.205505:0:9523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302127.205622:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121405824:0@lo:501: 00000100:00100000:3.0:1789302127.205651:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302127.205677:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc490b97d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302127.206079:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121405824 00000100:00100000:1.0:1789302127.206084:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121405824 00000100:00100000:1.0:1789302127.206141:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789302127.206148:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121405824:12345-0@lo:501: 00000100:00100000:1.0:1789302127.206236:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121405824:12345-0@lo:501: Request processed in 87us (583us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302127.206258:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789302127.206400:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121405824:0@lo:501: 10000000:01000000:3.0:1789302127.206424:0:9523:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789302127.206442:0:9523:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789302127.206457:0:9523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.206467:0:9523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.206474:0:9523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.206502:0:9523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789302127.206537:0:9523:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cc382b0f800 10000000:01000000:3.0:1789302127.206542:0:9523:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789302127.206556:0:9523:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789302127.206560:0:9523:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789302127.206564:0:9523:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789302127.206567:0:9523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789302127.206588:0:9523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.206596:0:9523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.206605:0:9523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302127.206619:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121405952:0@lo:101: 00000100:00100000:3.0:1789302127.206648:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302127.206673:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484efa600 going to sleep for 11 seconds 00000100:00100000:1.0:1789302127.206768:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121405952 00000100:00100000:1.0:1789302127.206773:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121405952 00000100:00100000:1.0:1789302127.206802:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789302127.206809:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121405952:12345-0@lo:101: 00010000:00010000:1.0:1789302127.206817:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302127.206828:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd399187 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399180 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.206848:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd399187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399180 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.206861:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd399187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399180 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.206868:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2179a00, rc 0) 00000100:00100000:1.0:1789302127.206907:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121405952:12345-0@lo:101: Request processed in 99us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.206914:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:1.0:1789302127.206936:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302127.206943:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.206951:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166f800 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302127.206955:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.206964:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302127.206992:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302127.206999:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302127.207020:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.207026:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302127.207048:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.207055:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48166f800/0x1ff82925bd399172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1ff82925bd399179 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.207069:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302127.207071:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302127.207072:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302127.207083:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121406080:0@lo:103: 00000100:00100000:1.0:1789302127.207145:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.207193:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121406080 00000100:00100000:1.0:1789302127.207197:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121406080 00000100:00100000:1.0:1789302127.207242:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302127.207249:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+17:3647:x1876219121406080:12345-0@lo:103: 00010000:00010000:1.0:1789302127.207258:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302127.207270:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd399179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd399172 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.207280:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302127.207323:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+16:3647:x1876219121406080:12345-0@lo:103: Request processed in 75us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.207331:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302127.207358:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121406080:0@lo:103: 00000100:00100000:3.0:1789302127.208184:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121405952:0@lo:101: 00010000:00010000:3.0:1789302127.208202:0:9523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.208271:0:9523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302127.208385:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406208:0@lo:501: 00000100:00100000:3.0:1789302127.208426:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302127.208442:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484efa600 going to sleep for 11 seconds 00000100:00100000:1.0:1789302127.208643:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121406208 00000100:00100000:1.0:1789302127.208649:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121406208 00000100:00100000:1.0:1789302127.208680:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789302127.208689:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121406208:12345-0@lo:501: 00000100:00100000:1.0:1789302127.208804:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121406208:12345-0@lo:501: Request processed in 115us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.208812:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789302127.208950:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406208:0@lo:501: 00000100:00100000:3.0:1789302127.208978:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406336:0@lo:503: 00000100:00100000:3.0:1789302127.209091:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302127.209140:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484efa600 going to sleep for 11 seconds 00000100:00100000:2.0:1789302127.209358:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789302127.209386:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121406336 00000100:00100000:2.0:1789302127.209390:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121406336 00000100:00100000:2.0:1789302127.209421:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789302127.209428:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:9523:x1876219121406336:12345-0@lo:503: 00000100:00100000:2.0:1789302127.209523:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:9523:x1876219121406336:12345-0@lo:503: Request processed in 95us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.209529:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789302127.209822:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406336:0@lo:503: 00000040:00080000:1.0:1789302127.210510:0:9523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789302127.210619:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406464:0@lo:502: 00000100:00100000:1.0:1789302127.210670:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.210705:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302127.210817:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121406464 00000100:00100000:2.0:1789302127.210823:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121406464 00000100:00100000:2.0:1789302127.210862:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789302127.210870:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:9523:x1876219121406464:12345-0@lo:502: 00000100:00100000:2.0:1789302127.210995:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+15:9523:x1876219121406464:12345-0@lo:502: Request processed in 114us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.211003:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789302127.211270:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406464:0@lo:502: 00000040:00080000:3.0:1789302127.211572:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789302127.211601:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789302127.211615:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789302127.211629:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789302127.211643:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789302127.211655:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789302127.211682:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406592:0@lo:502: 00000100:00100000:3.0:1789302127.211727:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302127.211763:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b5e98300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302127.212088:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121406592 00000100:00100000:2.0:1789302127.212096:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121406592 00000100:00100000:2.0:1789302127.212170:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789302127.212179:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:9523:x1876219121406592:12345-0@lo:502: 00000100:00100000:2.0:1789302127.212281:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:9523:x1876219121406592:12345-0@lo:502: Request processed in 103us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.212289:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789302127.212439:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406592:0@lo:502: 00000040:00080000:3.0:1789302127.212854:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789302127.212867:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1789302127.216196:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789302127.216223:0:9534:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789302127.216231:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302127.216234:0:9534:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789302127.216243:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302127.216265:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cc382628000) 00000020:00000080:3.0:1789302127.216311:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789302127.216323:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789302127.216424:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc382b0f800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789302127.216435:0:9534:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789302127.216444:0:9534:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1ff82925bd399195 00010000:00010000:3.0:1789302127.225763:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1789302127.226510:0:9534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789302127.229378:0:9534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789302127.230430:0:9534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789302127.238537:0:9534:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789302127.238815:0:9534:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789302127.246561:0:9534:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789302127.247890:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789302127.247904:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302127.247911:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302127.247914:0:9534:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789302127.247918:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302127.247922:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302127.247923:0:9534:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789302127.247926:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789302127.247928:0:9534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789302127.247952:0:9534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302127.247955:0:9534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302127.247956:0:9534:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789302127.247959:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789302127.250775:0:9523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789302127.250847:0:9523:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789302127.250878:0:9523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.250907:0:9523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302127.250917:0:9523:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc382b0f800 from 1 10000000:01000000:2.0:1789302127.250920:0:9523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789302127.250970:0:9523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.250990:0:9523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.251005:0:9523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.251035:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406720:0@lo:101: 00000100:00100000:2.0:1789302127.251144:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.251194:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33240 going to sleep for 11 seconds 00000100:00100000:2.0:1789302127.253146:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121406720 00000100:00100000:2.0:1789302127.253165:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121406720 00000100:00100000:2.0:1789302127.253321:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789302127.253335:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:9523:x1876219121406720:12345-0@lo:101: 00010000:00010000:2.0:1789302127.253355:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302127.253378:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd3991a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39919c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.253413:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd3991a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39919c expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.253427:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd3991a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39919c expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.253703:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982e00, rc 0) 00000100:00100000:2.0:1789302127.253787:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121406720:12345-0@lo:101: Request processed in 455us (2642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.253794:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789302127.253863:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406720:0@lo:101: 00010000:00010000:2.0:1789302127.253884:0:9523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.253895:0:9523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.256903:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406848:0@lo:501: 00000100:00100000:2.0:1789302127.257003:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.257072:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33240 going to sleep for 11 seconds 00000100:00100000:1.0:1789302127.259191:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121406848 00000100:00100000:1.0:1789302127.260052:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121406848 00000100:00100000:1.0:1789302127.260146:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789302127.260157:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121406848:12345-0@lo:501: 00000100:00100000:1.0:1789302127.260899:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121406848:12345-0@lo:501: Request processed in 742us (3894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.260910:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789302127.261430:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406848:0@lo:501: 00000100:00100000:1.0:1789302127.264098:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406976:0@lo:503: 00000100:00100000:1.0:1789302127.264741:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.264792:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302127.265342:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121406976 00000100:00100000:2.0:1789302127.265354:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121406976 00000100:00100000:2.0:1789302127.265432:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789302127.266051:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121406976:12345-0@lo:503: 00000100:00100000:2.0:1789302127.273057:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121406976:12345-0@lo:503: Request processed in 7601us (8304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.273077:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789302127.273228:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121406976:0@lo:503: 00000040:00080000:2.0:1789302127.274246:0:9523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789302127.274375:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407104:0@lo:502: 00000100:00100000:2.0:1789302127.274645:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.274701:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302127.276388:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121407104 00000100:00100000:0.0:1789302127.276403:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121407104 00000100:00100000:0.0:1789302127.276500:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789302127.276512:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121407104:12345-0@lo:502: 00000100:00100000:0.0:1789302127.276724:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121407104:12345-0@lo:502: Request processed in 213us (2079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302127.276733:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789302127.277476:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407104:0@lo:502: 00000040:00080000:2.0:1789302127.277786:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789302127.277828:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789302127.277871:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407232:0@lo:502: 00000100:00100000:2.0:1789302127.277933:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.277979:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302127.278403:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121407232 00000100:00100000:2.0:1789302127.278412:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121407232 00000100:00100000:2.0:1789302127.278527:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789302127.278538:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121407232:12345-0@lo:502: 00000100:00100000:2.0:1789302127.279889:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121407232:12345-0@lo:502: Request processed in 1345us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.279901:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789302127.280664:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407232:0@lo:502: 00000040:00080000:2.0:1789302127.280761:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789302127.280780:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789302127.283432:0:9538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302127.283460:0:9538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302127.283481:0:9538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789302127.283492:0:9538:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc382b0f800 00000020:00000080:1.0:1789302127.283494:0:9538:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789302127.283510:0:9538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302127.283513:0:9538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302127.283515:0:9538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789302127.283518:0:9538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789302127.283804:0:9523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789302127.283847:0:9523:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302127.283872:0:9523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.283887:0:9523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302127.283949:0:9523:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789302127.283959:0:9523:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cc382b0f800 10000000:01000000:2.0:1789302127.283962:0:9523:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cc382b0f800 10000000:01000000:2.0:1789302127.283966:0:9523:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789302127.283973:0:9523:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc382b0f800 from 1 10000000:01000000:2.0:1789302127.283976:0:9523:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789302127.284033:0:9523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.284042:0:9523:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.284056:0:9523:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302127.284084:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407360:0@lo:101: 00000100:00100000:2.0:1789302127.284202:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.284385:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33840 going to sleep for 11 seconds 00000100:00100000:1.0:1789302127.286167:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121407360 00000100:00100000:1.0:1789302127.286186:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121407360 00000100:00100000:1.0:1789302127.286268:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789302127.286280:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:9523:x1876219121407360:12345-0@lo:101: 00010000:00010000:1.0:1789302127.286309:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302127.286333:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd3991b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3991aa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.286369:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd3991b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3991aa expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.286383:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd3991b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3991aa expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.286393:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178200, rc 0) 00000100:00100000:1.0:1789302127.286505:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121407360:12345-0@lo:101: Request processed in 227us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.286514:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789302127.287052:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407360:0@lo:101: 00010000:00010000:3.0:1789302127.287080:0:9523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302127.287093:0:9523:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302127.287421:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407488:0@lo:501: 00000100:00100000:3.0:1789302127.287542:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302127.287655:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121407488 00000100:00100000:3.0:1789302127.287661:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121407488 00000100:00100000:3.0:1789302127.287705:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789302127.287713:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121407488:12345-0@lo:501: 00000100:00100000:3.0:1789302127.287839:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121407488:12345-0@lo:501: Request processed in 126us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302127.287847:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789302127.287889:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49a739cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302127.287905:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407488:0@lo:501: 00000100:00100000:3.0:1789302127.287936:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407616:0@lo:503: 00000100:00100000:3.0:1789302127.287974:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.298166:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121407616 00000100:00100000:1.0:1789302127.298192:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121407616 00000100:00100000:1.0:1789302127.298288:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789302127.298310:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121407616:12345-0@lo:503: 00000100:00100000:1.0:1789302127.298535:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121407616:12345-0@lo:503: Request processed in 236us (10559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.299054:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789302127.300498:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a6ef60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302127.300544:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407616:0@lo:503: 00000040:00080000:2.0:1789302127.301100:0:9523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789302127.301358:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407744:0@lo:502: 00000100:00100000:2.0:1789302127.301443:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.301873:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33840 going to sleep for 11 seconds 00000100:00100000:1.0:1789302127.301953:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121407744 00000100:00100000:1.0:1789302127.301962:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121407744 00000100:00100000:1.0:1789302127.302034:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789302127.302045:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121407744:12345-0@lo:502: 00000100:00100000:1.0:1789302127.302227:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121407744:12345-0@lo:502: Request processed in 182us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.302235:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789302127.302785:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407744:0@lo:502: 00000040:00080000:0.0:1789302127.304171:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789302127.304629:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789302127.304651:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789302127.304665:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789302127.304678:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789302127.304705:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789302127.304720:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789302127.304734:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789302127.304747:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789302127.304758:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789302127.304769:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789302127.304781:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789302127.304793:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789302127.304805:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789302127.304818:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789302127.304831:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789302127.304842:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789302127.304855:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789302127.304868:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789302127.305647:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789302127.305685:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789302127.305699:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789302127.305712:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789302127.305729:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789302127.305743:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789302127.305757:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789302127.305770:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789302127.305804:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789302127.305819:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789302127.305832:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789302127.305844:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789302127.305858:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789302127.305870:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789302127.307349:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789302127.307397:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789302127.307418:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789302127.307430:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1789302127.307440:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789302127.308052:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1789302127.308071:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1789302127.308084:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1789302127.308097:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1789302127.308310:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1789302127.308352:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1789302127.308369:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1789302127.308380:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1789302127.308442:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407872:0@lo:502: 00000100:00100000:0.0:1789302127.309386:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302127.309523:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4856fed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302127.314659:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121407872 00000100:00100000:1.0:1789302127.314679:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121407872 00000100:00100000:0.0:1789302127.315425:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789302127.315439:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121407872:12345-0@lo:502: 00000100:00100000:0.0:1789302127.315689:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121407872:12345-0@lo:502: Request processed in 252us (6577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302127.315698:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789302127.318004:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121407872:0@lo:502: 00000040:00080000:3.0:1789302127.318189:0:9523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1789302127.318206:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1789302127.319637:0:9539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789302127.319661:0:9539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cc38262b380) 00000020:00000080:3.0:1789302127.319693:0:9539:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1789302127.319780:0:9539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc382b0f800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789302127.319784:0:9539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc382b0f800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789302127.319787:0:9539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc382b0f800 3 00010000:00080000:3.0:1789302127.319822:0:9539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc38367d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.109@tcp at head 00010000:00010000:3.0:1789302127.328812:0:9539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1789302127.331366:0:9539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789302127.331428:0:9539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789302127.331445:0:9539:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1ff82925bd3991bf 00000100:00080000:3.0:1789302127.331525:0:9539:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302127.331538:0:9539:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cc38367d000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302127.331651:0:9539:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc485dd1880 x1876219121408000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302127.331718:0:9539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789302127.332198:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121408512:0@lo:400: 00000100:00100000:1.0:1789302127.332295:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.332342:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121409024:0@lo:400: 00000100:00100000:1.0:1789302127.332368:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.332393:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789302127.332399:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121408128:0@lo:400: 00000100:00100000:1.0:1789302127.332441:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.332742:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121408640:0@lo:400: 00000100:00100000:1.0:1789302127.332767:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.332801:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121408384:0@lo:400: 00000100:00100000:1.0:1789302127.332827:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.332845:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121408896:0@lo:400: 00000100:00100000:1.0:1789302127.332866:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.332886:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789302127.332892:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121408256:0@lo:400: 00000100:00100000:1.0:1789302127.332928:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.332947:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121408768:0@lo:400: 00000100:00100000:1.0:1789302127.332968:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.333006:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121408512 00000100:00100000:1.0:1789302127.333015:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121408512 00000100:00100000:1.0:1789302127.333064:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121408256 00000100:00100000:1.0:1789302127.333068:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121408256 00000100:00100000:1.0:1789302127.333088:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789302127.333097:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121408512:12345-0@lo:400: 00000100:00100000:1.0:1789302127.333179:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121408512:12345-0@lo:400: Request processed in 82us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.333186:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789302127.333206:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789302127.333213:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121408256:12345-0@lo:400: 00000100:00100000:3.0:1789302127.333349:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121408128 00000100:00100000:3.0:1789302127.333353:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121408128 00000100:00100000:3.0:1789302127.333382:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121408640 00000100:00100000:3.0:1789302127.333384:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121408640 00000100:00100000:3.0:1789302127.333409:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121408384 00000100:00100000:3.0:1789302127.333412:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121408384 00000100:00100000:3.0:1789302127.333422:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121408768 00000100:00100000:3.0:1789302127.333424:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121408768 00000100:00100000:3.0:1789302127.333437:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789302127.333618:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121408256:12345-0@lo:400: Request processed in 405us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.333623:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789302127.333645:0:6530:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789302127.333655:0:6530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789302127.333666:0:6531:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789302127.333672:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789302127.333677:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121408640:12345-0@lo:400: 00000100:00100000:1.0:1789302127.333707:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121408640:12345-0@lo:400: Request processed in 29us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.333712:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789302127.333729:0:6531:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789302127.333734:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789302127.333739:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121408384:12345-0@lo:400: 00000100:00100000:1.0:1789302127.333771:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121408384:12345-0@lo:400: Request processed in 31us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.333776:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789302127.333787:0:6531:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789302127.333792:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789302127.333797:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121408768:12345-0@lo:400: 00000100:00100000:1.0:1789302127.333824:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121408768:12345-0@lo:400: Request processed in 27us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.333830:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789302127.333877:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121408256:0@lo:400: 00010000:00080000:1.0:1789302127.333890:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b7e61500 x1876219121408768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302127.333900:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121408768:0@lo:400: 00010000:00080000:1.0:1789302127.333910:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b7e60e00 x1876219121408384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302127.333917:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121408384:0@lo:400: 00010000:00080000:1.0:1789302127.333951:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b7e63b80 x1876219121408640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302127.333960:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121408640:0@lo:400: 00000100:00100000:1.0:1789302127.333970:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121408512:0@lo:400: 00000100:00100000:3.0:1789302127.334057:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121408128:12345-0@lo:400: 00000100:00100000:3.0:1789302127.334094:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121408128:12345-0@lo:400: Request processed in 651us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302127.334100:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789302127.334152:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789302127.334157:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302127.334930:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876219121408000:0@lo:38: 00000100:00100000:0.0:1789302127.334995:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302127.335166:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121408000 00000100:00100000:3.0:1789302127.335175:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121408000 00000100:00100000:3.0:1789302127.335512:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302127.335520:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876219121408000:12345-0@lo:38: 00010000:00080000:3.0:1789302127.336424:0:6531:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00010000:00080000:1.0:1789302127.336671:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b7e60a80 x1876219121408128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302127.336688:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121408128:0@lo:400: 00000020:00000080:3.0:1789302127.337728:0:6531:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1ff82925bd3991c6 00000004:00100000:3.0:1789302127.337753:0:6531:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789302127.337803:0:6531:0:(import.c:65:import_set_state_nolock()) ffff8cc38380c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302127.337922:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876219121408000:12345-0@lo:38: Request processed in 2399us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302127.337933:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789302127.338532:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc485dd1880 x1876219121408000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302127.338554:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789302127.338564:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789302127.338574:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789302127.338581:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789302127.338584:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc38367d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789302127.338591:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876219121408000:0@lo:38: 00000020:01000004:3.0:1789302127.339817:0:9539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789302127.339868:0:9539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8cc383818000) 00000100:00100000:0.0:1789302127.340678:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121409024 00000100:00100000:0.0:1789302127.340700:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121409024 00000100:00100000:0.0:1789302127.340774:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121408896 00000100:00100000:0.0:1789302127.340777:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121408896 00000100:00100000:0.0:1789302127.340808:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789302127.340818:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121409024:12345-0@lo:400: 00000100:00100000:0.0:1789302127.340948:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121409024:12345-0@lo:400: Request processed in 131us (8579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302127.340957:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789302127.340973:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302127.340979:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121408896:12345-0@lo:400: 00010000:00080000:1.0:1789302127.341141:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b7e60700 x1876219121409024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302127.341158:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121409024:0@lo:400: 00000020:00000080:3.0:1789302127.341336:0:9539:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00080000:3.0:1789302127.341348:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302127.342405:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121408896:12345-0@lo:400: Request processed in 1423us (9534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302127.342414:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1789302127.342678:0:9539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc382b0f800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789302127.342684:0:9539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc382b0f800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789302127.342687:0:9539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc382b0f800 3 00010000:00080000:3.0:1789302127.342732:0:9539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc38380d800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.109@tcp at head 00010000:00080000:1.0:1789302127.343144:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4b7e62d80 x1876219121408896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302127.343160:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121408896:0@lo:400: 00000100:00100000:0.0:1789302127.345441:0:9540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9540:1876219121409152:0@lo:901: 00000100:00100000:0.0:1789302127.346182:0:9540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.347014:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121409152 00000100:00100000:1.0:1789302127.347027:0:6541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121409152 00000100:00100000:1.0:1789302127.347105:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302127.347138:0:6541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9540:x1876219121409152:12345-0@lo:901: 00000100:00100000:0.0:1789302127.347994:0:9540:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33840 going to sleep for 11 seconds 00000100:00100000:1.0:1789302127.348169:0:6541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9540:x1876219121409152:12345-0@lo:901: Request processed in 1032us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.348179:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789302127.349692:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789302127.349832:0:9540:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f74380 x1876219121409152/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789302143 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302127.349853:0:9540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9540:1876219121409152:0@lo:901: 00010000:00010000:3.0:1789302127.353409:0:9539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1789302127.362043:0:9539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789302127.362730:0:9539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789302127.362750:0:9539:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x1ff82925bd3991d4 00000100:00080000:3.0:1789302127.362764:0:9539:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302127.362778:0:9539:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8cc38380d800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302127.363097:0:9539:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc485dd1180 x1876219121409280/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302127.363152:0:9539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789302127.363937:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876219121409280:0@lo:38: 00000100:00100000:1.0:1789302127.364035:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302127.364551:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121409280 00000100:00100000:0.0:1789302127.364561:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121409280 00000100:00100000:0.0:1789302127.364617:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302127.364627:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121409280:12345-0@lo:38: 00010000:00080000:0.0:1789302127.364660:0:6532:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1789302127.364701:0:6532:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x1ff82925bd3991db 00000004:00100000:0.0:1789302127.364720:0:6532:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789302127.364763:0:6532:0:(import.c:65:import_set_state_nolock()) ffff8cc382b0c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302127.364842:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876219121409280:12345-0@lo:38: Request processed in 214us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302127.364850:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789302127.366763:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc485dd1180 x1876219121409280/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302127.366779:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789302127.366791:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789302127.366800:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789302127.366807:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789302127.366810:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc38380d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789302127.366817:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876219121409280:0@lo:38: 00000040:00080000:0.0:1789302127.367082:0:9539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1789302127.367376:0:9523:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1789302127.367413:0:9523:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302127.367434:0:9523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302127.367457:0:9523:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789302127.367534:0:9523:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789302127.367537:0:9523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789302127.367539:0:9523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302127.367540:0:9523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302127.367542:0:9523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302127.367543:0:9523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302127.367544:0:9523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302127.367546:0:9523:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302127.367547:0:9523:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302127.367549:0:9523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302127.367550:0:9523:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302127.367555:0:9523:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789302127.367557:0:9523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302127.367559:0:9523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789302127.367560:0:9523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302127.367561:0:9523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302127.367562:0:9523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302127.367563:0:9523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302127.367563:0:9523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302127.367565:0:9523:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302127.367566:0:9523:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302127.367567:0:9523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302127.367568:0:9523:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302127.367596:0:9523:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789302127.367615:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121409408:0@lo:253: 00000100:00100000:2.0:1789302127.367684:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302127.367722:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852cdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302127.367750:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121409408 00000100:00100000:2.0:1789302127.367758:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121409408 00000100:00100000:2.0:1789302127.367807:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789302127.367817:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121409408:12345-0@lo:253: 20000000:01000000:2.0:1789302127.367851:0:6524:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789302127.367869:0:6524:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789302127.380146:0:6524:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789302127.380178:0:6524:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789302127.380639:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:9523:x1876219121409408:12345-0@lo:253: Request processed in 12816us (12947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302127.380652:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789302127.380734:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:483e1a3c-0199-48dd-94ee-f480825c6196:9523:1876219121409408:0@lo:253: 10000000:01000000:2.0:1789302127.380751:0:9523:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789302127.380755:0:9523:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789302127.380757:0:9523:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789302127.380759:0:9523:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302127.380761:0:9523:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302127.380762:0:9523:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302127.380764:0:9523:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302127.380765:0:9523:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302127.380767:0:9523:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302127.380768:0:9523:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302127.380770:0:9523:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302127.380772:0:9523:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789302127.380788:0:9523:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789302127.381171:0:6546:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789302127.381178:0:6546:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789302127.381203:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302127.383571:0:6546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48166f200/0x1ff82925bd3990d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3990d1 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302127.383584:0:6546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd39911e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399117 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302127.383592:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302127.383654:0:6546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd39911e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399117 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302127.383675:0:6546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd39911e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399117 expref: 16 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302127.383694:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121409536:0@lo:104: 00000100:00100000:0.0:1789302127.383766:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302127.383835:0:6546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48166f200/0x1ff82925bd3990d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd3990d1 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302127.383843:0:6546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc48166f200/0x1ff82925bd3990d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd3990d1 expref: 16 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302127.383875:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121409664:0@lo:104: 00000100:00100000:0.0:1789302127.383900:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302127.383923:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3828cb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302127.383961:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121409536 00000100:00100000:0.0:1789302127.383970:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121409536 00000100:00100000:0.0:1789302127.384011:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121409664 00000100:00100000:0.0:1789302127.384013:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121409664 00000100:00100000:0.0:1789302127.384026:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789302127.384036:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+4:6546:x1876219121409536:12345-0@lo:104: 00010000:00010000:0.0:1789302127.384050:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302127.384109:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302127.384134:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+4:6546:x1876219121409536:12345-0@lo:104: Request processed in 99us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302127.384141:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789302127.384158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789302127.384164:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:6546:x1876219121409664:12345-0@lo:104: 00010000:00010000:0.0:1789302127.384171:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302127.384202:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789302127.384206:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:6546:x1876219121409664:12345-0@lo:104: Request processed in 44us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302127.384541:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789302127.384585:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121409536:0@lo:104: 00000100:00100000:0.0:1789302127.384595:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6546:1876219121409664:0@lo:104: 00010000:00010000:0.0:1789302127.384629:0:6546:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.385565:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302127.385587:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.385596:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982a00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302127.385601:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.385612:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302127.385620:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302127.385627:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302127.385682:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.385689:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302127.385712:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.385719:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982a00/0x1ff82925bd399117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39911e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.385734:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302127.385738:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.385743:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f200 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302127.385746:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.385762:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302127.385769:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302127.385774:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302127.385787:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.385793:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302127.385809:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.385815:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f200/0x1ff82925bd3990d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3990d8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.385828:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302127.385830:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302127.385831:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302127.385838:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302127.385853:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121409792:0@lo:103: 00000100:00100000:1.0:1789302127.385909:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.385968:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121409920:0@lo:103: 00000100:00100000:1.0:1789302127.386005:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.386042:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121409792 00000100:00100000:1.0:1789302127.386049:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121409792 00010000:00010000:1.0:1789302127.386080:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd39911e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399117 expref: 17 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302127.386170:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121409920 00000100:00100000:1.0:1789302127.386174:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121409920 00010000:00010000:1.0:1789302127.386187:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48166f200/0x1ff82925bd3990d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3990d1 expref: 18 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302127.386201:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302127.386222:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+18:3648:x1876219121409792:12345-0@lo:103: 00010000:00010000:1.0:1789302127.386237:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302127.386242:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd39911e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399117 expref: 18 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386253:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd39911e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399117 expref: 18 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386267:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd39911e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399117 expref: 18 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386280:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302127.386325:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+17:3648:x1876219121409792:12345-0@lo:103: Request processed in 116us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.386332:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302127.386348:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302127.386353:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+16:3645:x1876219121409920:12345-0@lo:103: 00010000:00010000:1.0:1789302127.386378:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302127.386383:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48166f200/0x1ff82925bd3990d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3990d1 expref: 16 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386391:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48166f200/0x1ff82925bd3990d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd3990d1 expref: 16 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386407:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166f200/0x1ff82925bd3990d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd3990d1 expref: 16 pid: 6523 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386419:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386429:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789302127.386456:0:6515:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005339851s 00010000:00010000:1.0:1789302127.386462:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386471:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386477:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386484:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386490:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302127.386495:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386502:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386518:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386539:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302127.386567:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+15:3645:x1876219121409920:12345-0@lo:103: Request processed in 214us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.386574:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302127.386613:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121409792:0@lo:103: 00000100:00100000:1.0:1789302127.386640:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121409920:0@lo:103: 00010000:00010000:1.0:1789302127.386655:0:6546:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386664:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302127.386671:0:6546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd3991e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789302127.400977:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789302127.401173:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789302127.404422:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789302127.405421:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789302127.406761:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789302127.408874:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789302127.413093:0:9523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789302127.427059:0:9523:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789302127.427073:0:9523:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789302127.427573:0:9523:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789302127.427631:0:9523:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.109@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789302127.427656:0:9523:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789302127.427695:0:9523:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789302127.439840:0:9523:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302127.440389:0:9523:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1789302127.700293:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302127.700337:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121410048:0@lo:41: 00000100:00100000:1.0:1789302127.701576:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302127.701658:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121410048 00000100:00100000:1.0:1789302127.701668:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121410048 00000100:00100000:1.0:1789302127.701722:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789302127.701734:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121410048:12345-0@lo:41: 00000004:00000024:1.0:1789302127.701781:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1789302127.702790:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121410048:12345-0@lo:41: Request processed in 1052us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302127.702802:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789302127.703140:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121410048:0@lo:41: 00010000:00010000:1.0:1789302128.020874:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789302128.793013:0:9597:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789302128.793588:0:9597:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789302129.044550:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302130.069628:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302130.260564:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121410176:0@lo:13: 00000100:00100000:1.0:1789302130.260638:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302130.260711:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121410176 00000100:00100000:0.0:1789302130.261071:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121410304:0@lo:13: 00000100:00100000:0.0:1789302130.261108:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302130.261496:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121410304 00000100:00100000:2.0:1789302130.261504:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121410304 00000100:00100000:2.0:1789302130.261595:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302130.261608:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121410304:12345-0@lo:13: 00002000:00000024:2.0:1789302130.261649:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302130.261704:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121410304:12345-0@lo:13: Request processed in 100us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302130.261710:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789302130.261751:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383416d80 x1876219121410304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302130.261770:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121410304:0@lo:13: 00000100:00100000:1.0:1789302130.262419:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121410176 00000100:00080000:0.0:1789302130.263949:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302130.265984:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302130.265998:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121410176:12345-0@lo:13: 00002000:00000024:1.0:1789302130.266023:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302130.266099:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121410176:12345-0@lo:13: Request processed in 105us (5460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302130.266106:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789302130.266527:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383806a00 x1876219121410176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302130.266551:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121410176:0@lo:13: 00010000:00010000:1.0:1789302131.093252:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302131.796305:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121410432:0@lo:41: 00000100:00100000:3.0:1789302131.796380:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302131.796544:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121410432 00000100:00100000:2.0:1789302131.796552:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121410432 00000100:00100000:2.0:1789302131.796605:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789302131.796614:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121410432:12345-0@lo:41: 00000004:00000024:2.0:1789302131.796643:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789302131.796694:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121410432:12345-0@lo:41: Request processed in 81us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302131.796700:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789302131.797539:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121410432:0@lo:41: 00010000:00010000:1.0:1789302132.116288:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302132.823785:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121410560:0@lo:41: 00000100:00100000:3.0:1789302132.823868:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302132.823950:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121410560 00000100:00100000:3.0:1789302132.823958:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121410560 00000100:00100000:3.0:1789302132.824015:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789302132.824024:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121410560:12345-0@lo:41: 00000004:00000024:3.0:1789302132.824059:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789302132.824105:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121410560:12345-0@lo:41: Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302132.824130:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789302132.824178:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121410560:0@lo:41: 00000100:00100000:1.0:1789302132.824359:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121410816:0@lo:400: 00000100:00100000:1.0:1789302132.824392:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302132.824424:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121411328:0@lo:400: 00000100:00100000:1.0:1789302132.824445:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302132.824461:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121411840:0@lo:400: 00000100:00100000:1.0:1789302132.824481:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302132.824506:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789302132.824512:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121410688:0@lo:400: 00000100:00100000:1.0:1789302132.824551:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302132.824588:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121411200:0@lo:400: 00000100:00100000:1.0:1789302132.824611:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302132.824628:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121411712:0@lo:400: 00000100:00100000:1.0:1789302132.824653:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302132.824675:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121410816 00000100:00100000:1.0:1789302132.824680:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121410816 00000100:00100000:1.0:1789302132.824702:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121411328 00000100:00100000:1.0:1789302132.824704:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121411328 00000100:00100000:1.0:1789302132.824729:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121411840 00000100:00100000:1.0:1789302132.824732:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121411840 00000100:00100000:1.0:1789302132.824744:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121411200 00000100:00100000:1.0:1789302132.824747:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121411200 00000100:00100000:1.0:1789302132.824759:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121411712 00000100:00100000:1.0:1789302132.824761:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121411712 00000100:00100000:1.0:1789302132.824775:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789302132.824781:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121410816:12345-0@lo:400: 00000100:00100000:1.0:1789302132.824818:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121410816:12345-0@lo:400: Request processed in 37us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302132.824825:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789302132.824840:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789302132.824847:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121411328:12345-0@lo:400: 00000100:00100000:1.0:1789302132.824874:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121411328:12345-0@lo:400: Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302132.824879:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789302132.824893:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789302132.824899:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121411840:12345-0@lo:400: 00000100:00100000:1.0:1789302132.824924:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121411840:12345-0@lo:400: Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302132.824939:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789302132.824953:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789302132.824959:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121411200:12345-0@lo:400: 00000100:00100000:1.0:1789302132.824987:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121411200:12345-0@lo:400: Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302132.824993:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789302132.825005:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789302132.825011:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121411712:12345-0@lo:400: 00000100:00100000:1.0:1789302132.825034:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121411712:12345-0@lo:400: Request processed in 23us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302132.825040:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789302132.825065:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302132.825068:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789302132.825088:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383805f80 x1876219121411200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302132.825100:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121411200:0@lo:400: 00010000:00080000:1.0:1789302132.825136:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e60700 x1876219121411712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302132.825144:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121411712:0@lo:400: 00010000:00080000:1.0:1789302132.825154:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383805880 x1876219121410816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302132.825161:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121410816:0@lo:400: 00010000:00080000:1.0:1789302132.825169:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383807800 x1876219121411328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302132.825189:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121411328:0@lo:400: 00010000:00080000:1.0:1789302132.825200:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e60a80 x1876219121411840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302132.825207:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121411840:0@lo:400: 00000100:00100000:3.0:1789302132.825680:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121410944:0@lo:400: 00000100:00100000:3.0:1789302132.825717:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302132.825736:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121411456:0@lo:400: 00000100:00100000:3.0:1789302132.825758:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302132.825779:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789302132.825784:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121411072:0@lo:400: 00000100:00100000:3.0:1789302132.825804:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302132.825822:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121411584:0@lo:400: 00000100:00100000:3.0:1789302132.825844:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302132.825871:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121411456 00000100:00100000:3.0:1789302132.825875:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121411456 00000100:00100000:3.0:1789302132.825912:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121411584 00000100:00100000:3.0:1789302132.825915:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121411584 00000100:00100000:3.0:1789302132.825944:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302132.825951:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121411456:12345-0@lo:400: 00000100:00100000:3.0:1789302132.826001:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121411456:12345-0@lo:400: Request processed in 38us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302132.826007:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302132.826023:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302132.826029:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121411584:12345-0@lo:400: 00000100:00100000:3.0:1789302132.826064:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121411584:12345-0@lo:400: Request processed in 36us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302132.826071:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302132.826088:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121411072 00000100:00100000:3.0:1789302132.826091:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121411072 00000100:00100000:3.0:1789302132.826129:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789302132.826136:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121411072:12345-0@lo:400: 00000100:00100000:3.0:1789302132.826180:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121411072:12345-0@lo:400: Request processed in 44us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302132.826186:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789302132.826212:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302132.826240:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121411072:0@lo:400: 00010000:00080000:3.0:1789302132.826251:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e62d80 x1876219121411584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302132.826270:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121411584:0@lo:400: 00010000:00080000:3.0:1789302132.826281:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383806a00 x1876219121411456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302132.826288:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121411456:0@lo:400: 00000100:00100000:0.0:1789302132.826788:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121410688 00000100:00100000:0.0:1789302132.826794:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121410688 00000100:00100000:0.0:1789302132.826839:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789302132.826847:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:3648:x1876219121410688:12345-0@lo:400: 00000100:00100000:0.0:1789302132.826891:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+15:3648:x1876219121410688:12345-0@lo:400: Request processed in 45us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302132.826896:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789302132.827953:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121410944 00000100:00100000:1.0:1789302132.827963:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121410944 00000100:00100000:1.0:1789302132.828012:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789302132.828019:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121410944:12345-0@lo:400: 00000100:00100000:1.0:1789302132.828078:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121410944:12345-0@lo:400: Request processed in 60us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302132.828085:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789302132.828146:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121410688:0@lo:400: 00010000:00080000:3.0:1789302132.828476:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383805180 x1876219121410944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302132.828488:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121410944:0@lo:400: 00010000:00010000:3.0:1789302133.140319:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302134.169229:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789302134.177824:0:9886:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1789302135.032691:0:9938:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302135.032927:0:9938:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789302135.188197:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302135.386143:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121411968:0@lo:13: 00000100:00100000:2.0:1789302135.386220:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302135.386305:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121411968 00000100:00100000:2.0:1789302135.386313:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121411968 00000100:00100000:2.0:1789302135.386361:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789302135.386373:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121411968:12345-0@lo:13: 00002000:00000024:2.0:1789302135.386399:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302135.386479:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121411968:12345-0@lo:13: Request processed in 109us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302135.386485:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789302135.386505:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302135.388322:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383414a80 x1876219121411968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302135.388346:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121411968:0@lo:13: 00000100:00100000:2.0:1789302135.388369:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302135.388377:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121412096:0@lo:13: 00000100:00100000:2.0:1789302135.388433:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302135.388524:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121412096 00000100:00100000:1.0:1789302135.388532:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121412096 00000100:00100000:1.0:1789302135.388586:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302135.388595:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121412096:12345-0@lo:13: 00002000:00000024:1.0:1789302135.388612:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302135.388654:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121412096:12345-0@lo:13: Request processed in 59us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302135.388660:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789302135.390258:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302135.390299:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e60a80 x1876219121412096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302135.390319:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121412096:0@lo:13: 00010000:00010000:3.0:1789302136.212447:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302136.918822:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121412224:0@lo:41: 00000100:00100000:2.0:1789302136.918881:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.918946:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121412224 00000100:00100000:2.0:1789302136.918952:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121412224 00000100:00100000:2.0:1789302136.918991:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789302136.918998:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121412224:12345-0@lo:41: 00000004:00000024:2.0:1789302136.919024:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 10000000:01000000:0.0:1789302136.919095:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789302136.919101:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4adc31000 from 39 10000000:01000000:0.0:1789302136.919105:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:2.0:1789302136.919139:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121412224:12345-0@lo:41: Request processed in 140us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.919145:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:0.0:1789302136.919159:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.919172:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302136.919181:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121412224:0@lo:41: 00010000:00010000:0.0:1789302136.919183:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302136.919213:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121412352:0@lo:101: 00000100:00100000:0.0:1789302136.919264:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.919879:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a04f9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302136.921557:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121412352 00000100:00100000:2.0:1789302136.921570:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121412352 00000100:00100000:2.0:1789302136.921679:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789302136.921689:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121412352:12345-0@lo:101: 00010000:00010000:2.0:1789302136.921703:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302136.921732:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd3991f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3991e9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.921772:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd3991f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3991e9 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.921784:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd3991f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3991e9 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.921793:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983200, rc 0) 00000100:00100000:2.0:1789302136.921870:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121412352:12345-0@lo:101: Request processed in 182us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.921878:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789302136.923003:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121412352:0@lo:101: 00010000:00010000:1.0:1789302136.923027:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.923046:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302136.923158:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121412480:0@lo:501: 00000100:00100000:1.0:1789302136.923202:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302136.932145:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382767540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.934564:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121412480 00000100:00100000:0.0:1789302136.934580:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121412480 00000100:00100000:0.0:1789302136.934641:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789302136.934650:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121412480:12345-0@lo:501: 00000100:00100000:0.0:1789302136.934828:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121412480:12345-0@lo:501: Request processed in 178us (11625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.934836:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789302136.935011:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121412480:0@lo:501: 00000100:00100000:0.0:1789302136.935063:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121412608:0@lo:503: 00000100:00100000:0.0:1789302136.935133:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.935154:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a04f9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.935167:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121412608 00000100:00100000:0.0:1789302136.935171:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121412608 00000100:00100000:0.0:1789302136.935189:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789302136.935194:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121412608:12345-0@lo:503: 00000100:00100000:0.0:1789302136.936105:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121412608:12345-0@lo:503: Request processed in 907us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.936130:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789302136.936186:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121412608:0@lo:503: 00000100:00100000:0.0:1789302136.936380:0:10007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10007:1876219121412736:0@lo:502: 00000100:00100000:0.0:1789302136.936417:0:10007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.936445:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121412736 00000100:00100000:0.0:1789302136.936450:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121412736 00000100:00100000:0.0:1789302136.936471:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789302136.936478:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:10007:x1876219121412736:12345-0@lo:502: 00000100:00100000:0.0:1789302136.936556:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:10007:x1876219121412736:12345-0@lo:502: Request processed in 78us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.936563:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789302136.936598:0:10007:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a04f9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.936610:0:10007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10007:1876219121412736:0@lo:502: 00000100:00100000:0.0:1789302136.936645:0:10007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10007:1876219121412864:0@lo:502: 00000100:00100000:0.0:1789302136.936674:0:10007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.936692:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121412864 00000100:00100000:0.0:1789302136.936696:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121412864 00000100:00100000:0.0:1789302136.936712:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789302136.936717:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:10007:x1876219121412864:12345-0@lo:502: 00000100:00100000:0.0:1789302136.936774:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:10007:x1876219121412864:12345-0@lo:502: Request processed in 55us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.936780:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789302136.936807:0:10007:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a04f9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.936818:0:10007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10007:1876219121412864:0@lo:502: 00000040:00080000:0.0:1789302136.936836:0:10007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789302136.936895:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789302136.938137:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789302136.938151:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.938163:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302136.938180:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789302136.938183:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789302136.938186:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789302136.938216:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.938224:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.938251:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302136.938269:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121412992:0@lo:101: 00000100:00100000:0.0:1789302136.938317:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.938341:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.938366:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121412992 00000100:00100000:0.0:1789302136.938371:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121412992 00000100:00100000:0.0:1789302136.938405:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789302136.938413:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121412992:12345-0@lo:101: 00010000:00010000:0.0:1789302136.938424:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302136.938435:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538f200/0x1ff82925bd3991fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3991f7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.938459:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538f200/0x1ff82925bd3991fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3991f7 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.938469:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538f200/0x1ff82925bd3991fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3991f7 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.938488:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538f200, rc 0) 00000100:00100000:0.0:1789302136.938522:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121412992:12345-0@lo:101: Request processed in 109us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.938528:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789302136.938567:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121412992:0@lo:101: 00010000:00010000:0.0:1789302136.938581:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.938589:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302136.938636:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121413120:0@lo:501: 00000100:00100000:0.0:1789302136.938659:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.938672:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a04f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.938684:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121413120 00000100:00100000:0.0:1789302136.938688:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121413120 00000100:00100000:0.0:1789302136.938704:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789302136.938710:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121413120:12345-0@lo:501: 00000100:00100000:0.0:1789302136.938807:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121413120:12345-0@lo:501: Request processed in 97us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.938814:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789302136.938841:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121413120:0@lo:501: 00000100:00100000:0.0:1789302136.938863:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121413248:0@lo:503: 00000100:00100000:0.0:1789302136.938894:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.938905:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302136.939997:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121413248 00000100:00100000:2.0:1789302136.940005:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121413248 00000100:00100000:2.0:1789302136.940043:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789302136.940051:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121413248:12345-0@lo:503: 00000100:00100000:2.0:1789302136.940171:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121413248:12345-0@lo:503: Request processed in 120us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.940178:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789302136.940534:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121413248:0@lo:503: 00000100:00100000:3.0:1789302136.943684:0:10008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10008:1876219121413376:0@lo:502: 00000100:00100000:3.0:1789302136.943776:0:10008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302136.943837:0:10008:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3839c5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.944393:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121413376 00000100:00100000:0.0:1789302136.944400:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121413376 00000100:00100000:0.0:1789302136.944449:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789302136.944459:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:10008:x1876219121413376:12345-0@lo:502: 00000100:00100000:0.0:1789302136.944580:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:10008:x1876219121413376:12345-0@lo:502: Request processed in 122us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.944588:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789302136.944745:0:10008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10008:1876219121413376:0@lo:502: 00000020:01000000:3.0:1789302136.944774:0:10008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302136.944783:0:10008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302136.944786:0:10008:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789302136.944792:0:10008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789302136.944803:0:10008:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789302136.944822:0:10008:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10008:1876219121413504:0@lo:502: 00000100:00100000:3.0:1789302136.944858:0:10008:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302136.944896:0:10008:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3839c5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.945601:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121413504 00000100:00100000:0.0:1789302136.945607:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121413504 00000100:00100000:0.0:1789302136.945641:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789302136.945649:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:10008:x1876219121413504:12345-0@lo:502: 00000100:00100000:0.0:1789302136.945732:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:10008:x1876219121413504:12345-0@lo:502: Request processed in 84us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.945739:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789302136.945764:0:10008:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10008:1876219121413504:0@lo:502: 00000020:01000000:1.0:1789302136.945792:0:10008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302136.945798:0:10008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302136.945800:0:10008:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789302136.945804:0:10008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789302136.946037:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789302136.946063:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789302136.946073:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.946084:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302136.946093:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789302136.946096:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4b511e800 from 39 10000000:01000000:0.0:1789302136.946099:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789302136.946152:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.946172:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.946182:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302136.946197:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121413632:0@lo:101: 00000100:00100000:0.0:1789302136.946227:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.946270:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc840 going to sleep for 11 seconds 00000100:00100000:1.0:1789302136.947399:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121413632 00000100:00100000:1.0:1789302136.947407:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121413632 00000100:00100000:1.0:1789302136.947441:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789302136.947450:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121413632:12345-0@lo:101: 00010000:00010000:1.0:1789302136.947460:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302136.947475:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4c2178400/0x1ff82925bd39920c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399205 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.947500:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2178400/0x1ff82925bd39920c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399205 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.947511:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4c2178400/0x1ff82925bd39920c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399205 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.947519:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178400, rc 0) 00000100:00100000:1.0:1789302136.947576:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121413632:12345-0@lo:101: Request processed in 127us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302136.947591:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789302136.947877:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121413632:0@lo:101: 00010000:00010000:3.0:1789302136.947900:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302136.947910:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302136.948067:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd96ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121413760:0@lo:501: 00000100:00100000:3.0:1789302136.948096:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302136.948151:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3839c5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789302136.950033:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121413760 00000100:00100000:2.0:1789302136.950043:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121413760 00000100:00100000:2.0:1789302136.950098:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789302136.950105:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121413760:12345-0@lo:501: 00000100:00100000:3.0:1789302136.951087:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121413760:12345-0@lo:501: Request processed in 847us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302136.951098:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789302136.951350:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd96ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121413760:0@lo:501: 00000100:00100000:0.0:1789302136.951404:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121413888:0@lo:503: 00000100:00100000:0.0:1789302136.951455:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.951498:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302136.951834:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121413888 00000100:00100000:1.0:1789302136.951842:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121413888 00000100:00100000:1.0:1789302136.951893:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789302136.951903:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121413888:12345-0@lo:503: 00000100:00100000:1.0:1789302136.952009:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121413888:12345-0@lo:503: Request processed in 108us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302136.952017:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789302136.952021:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121413888:0@lo:503: 00000100:00100000:0.0:1789302136.952759:0:10010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10010:1876219121414016:0@lo:502: 00000100:00100000:0.0:1789302136.952815:0:10010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.952843:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121414016 00000100:00100000:0.0:1789302136.952847:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121414016 00000100:00100000:0.0:1789302136.952883:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789302136.952890:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:10010:x1876219121414016:12345-0@lo:502: 00000100:00100000:0.0:1789302136.952974:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:10010:x1876219121414016:12345-0@lo:502: Request processed in 84us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.952981:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789302136.953016:0:10010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.953040:0:10010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10010:1876219121414016:0@lo:502: 00000100:00100000:0.0:1789302136.953083:0:10010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10010:1876219121414144:0@lo:502: 00000100:00100000:0.0:1789302136.953152:0:10010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.953167:0:10010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302136.953340:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121414144 00000100:00100000:1.0:1789302136.953345:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121414144 00000100:00100000:1.0:1789302136.953369:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789302136.953376:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:10010:x1876219121414144:12345-0@lo:502: 00000100:00100000:1.0:1789302136.953445:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:10010:x1876219121414144:12345-0@lo:502: Request processed in 69us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302136.953452:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789302136.953534:0:10010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10010:1876219121414144:0@lo:502: 00000040:00080000:0.0:1789302136.953553:0:10010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789302136.954006:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789302136.954028:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789302136.954037:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.954047:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302136.954057:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789302136.954059:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b511e800 from 6 10000000:01000000:1.0:1789302136.954062:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789302136.954089:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.954105:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.954212:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302136.954228:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121414272:0@lo:101: 00000100:00100000:1.0:1789302136.954336:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302136.954402:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382767300 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.963552:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121414272 00000100:00100000:0.0:1789302136.963566:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121414272 00000100:00100000:0.0:1789302136.963620:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789302136.963629:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121414272:12345-0@lo:101: 00010000:00010000:0.0:1789302136.963645:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302136.963664:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd39921a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399213 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.963689:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd39921a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399213 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.963700:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd39921a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399213 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.963708:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538f800, rc 0) 00000100:00100000:0.0:1789302136.963782:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121414272:12345-0@lo:101: Request processed in 153us (9444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.963788:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789302136.963871:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121414272:0@lo:101: 00010000:00010000:0.0:1789302136.963899:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.963930:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302136.963991:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121414400:0@lo:256: 00000100:00100000:0.0:1789302136.964028:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.964065:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121414400 00000100:00100000:0.0:1789302136.964065:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302136.964070:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121414400 00000100:00100000:2.0:1789302136.964106:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789302136.964195:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121414400:12345-0@lo:256: 20000000:01000000:2.0:1789302136.964210:0:6523:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789302136.964229:0:6523:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789302136.964240:0:6523:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789302136.964330:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121414400:12345-0@lo:256: Request processed in 217us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.964337:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789302136.966369:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121414400:0@lo:256: 10000000:01000000:0.0:1789302136.966433:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789302136.966441:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.966451:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302136.966459:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789302136.966462:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1789302136.966533:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789302136.966565:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.966574:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.966583:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302136.966602:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121414528:0@lo:101: 00000100:00100000:0.0:1789302136.966664:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.966756:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302136.966891:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121414528 00000100:00100000:2.0:1789302136.966898:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121414528 00000100:00100000:2.0:1789302136.967017:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789302136.967036:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121414528:12345-0@lo:101: 00010000:00010000:2.0:1789302136.967049:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302136.967061:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983a00/0x1ff82925bd399228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399221 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.967084:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983a00/0x1ff82925bd399228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399221 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.967094:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa983a00/0x1ff82925bd399228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399221 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.967103:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983a00, rc 0) 00000100:00100000:2.0:1789302136.967174:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121414528:12345-0@lo:101: Request processed in 148us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.967180:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789302136.967790:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121414528:0@lo:101: 00010000:00010000:1.0:1789302136.968016:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.968026:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302136.968094:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121414656:0@lo:501: 00000100:00100000:1.0:1789302136.968144:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302136.968175:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382767300 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.968607:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121414656 00000100:00100000:0.0:1789302136.968613:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121414656 00000100:00100000:0.0:1789302136.968651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789302136.968659:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121414656:12345-0@lo:501: 00000100:00100000:0.0:1789302136.969101:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121414656:12345-0@lo:501: Request processed in 441us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.969337:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789302136.970593:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121414656:0@lo:501: 00000100:00100000:1.0:1789302136.970638:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121414784:0@lo:503: 00000100:00100000:1.0:1789302136.970687:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302136.970725:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382767300 going to sleep for 11 seconds 00000100:00100000:3.0:1789302136.974513:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121414784 00000100:00100000:3.0:1789302136.974527:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121414784 00000100:00100000:3.0:1789302136.974596:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789302136.974606:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121414784:12345-0@lo:503: 00000100:00100000:3.0:1789302136.974772:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121414784:12345-0@lo:503: Request processed in 158us (4074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302136.974780:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789302136.975044:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121414784:0@lo:503: 00000100:00100000:1.0:1789302136.975435:0:10012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10012:1876219121414912:0@lo:502: 00000100:00100000:1.0:1789302136.975486:0:10012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302136.975524:0:10012:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382767540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302136.975567:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121414912 00000100:00100000:3.0:1789302136.975571:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121414912 00000100:00100000:3.0:1789302136.975607:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789302136.975615:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:10012:x1876219121414912:12345-0@lo:502: 00000100:00100000:3.0:1789302136.975697:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:10012:x1876219121414912:12345-0@lo:502: Request processed in 83us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302136.975704:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789302136.975889:0:10012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10012:1876219121414912:0@lo:502: 00000020:01000000:1.0:1789302136.975922:0:10012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789302136.975929:0:10012:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789302136.975940:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302136.975943:0:10012:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789302136.975947:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789302136.975952:0:10012:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:01000000:1.0:1789302136.975974:0:10012:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789302136.975977:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789302136.975990:0:10012:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8cc381fc3380) 00000020:00000080:1.0:1789302136.976012:0:10012:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1789302136.976018:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789302136.976091:0:10012:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789302136.976097:0:10012:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789302136.976104:0:10012:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd399236 00010000:00080000:1.0:1789302136.976160:0:10012:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc3839ba800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.109@tcp at head 00010000:00010000:1.0:1789302136.976384:0:10012:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1789302136.976490:0:10012:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789302136.976506:0:10012:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789302136.976668:0:10012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302136.977073:0:10012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302136.977291:0:10012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789302136.977380:0:10012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789302136.978366:0:10013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789302136.978371:0:10013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789302136.979008:0:10012:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789302136.979019:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789302136.979054:0:10012:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789302136.979077:0:10012:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd39923d 00000100:00080000:1.0:1789302136.979088:0:10012:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789302136.979106:0:10012:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cc3839ba800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302136.979173:0:10012:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4b7e60a80 x1876219121415040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302136.979194:0:10012:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789302136.979260:0:10012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302136.979264:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302136.979265:0:10012:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789302136.979268:0:10012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302136.979272:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302136.979274:0:10012:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789302136.979276:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789302136.979278:0:10012:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789302136.979305:0:10012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10012:1876219121415168:0@lo:502: 00000100:00100000:1.0:1789302136.979379:0:10012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302136.979413:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121415168 00000100:00100000:1.0:1789302136.979419:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121415168 00000100:00100000:1.0:1789302136.979454:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789302136.979462:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:10012:x1876219121415168:12345-0@lo:502: 00000100:00100000:1.0:1789302136.979564:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:10012:x1876219121415168:12345-0@lo:502: Request processed in 102us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302136.979571:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789302136.979612:0:10012:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7f07840 going to sleep for 11 seconds 00000100:00100000:1.0:1789302136.979630:0:10012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10012:1876219121415168:0@lo:502: 00000020:01000000:1.0:1789302136.979656:0:10012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302136.979660:0:10012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302136.979661:0:10012:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789302136.979664:0:10012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:2.0:1789302136.979853:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121415296:0@lo:400: 00000100:00100000:0.0:1789302136.979853:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121415040:0@lo:8: 00000100:00100000:2.0:1789302136.979883:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.979884:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.979907:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121415808:0@lo:400: 00000100:00100000:0.0:1789302136.979915:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121415040 00000100:00100000:0.0:1789302136.979919:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121415040 00000100:00100000:2.0:1789302136.979939:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.979943:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789302136.979948:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876219121415040:12345-0@lo:8: 00000100:00100000:2.0:1789302136.979961:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121416320:0@lo:400: 00010000:00080000:0.0:1789302136.979969:0:8852:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000100:00100000:2.0:1789302136.979983:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789302136.979991:0:8852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd399244 00000100:00100000:2.0:1789302136.980000:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00002000:00100000:0.0:1789302136.980003:0:8852:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8cc382b08800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00000100:00100000:2.0:1789302136.980005:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121415680:0@lo:400: 00002000:00080000:0.0:1789302136.980007:0:8852:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1789302136.980011:0:8852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789302136.980026:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.980042:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121416192:0@lo:400: 00000100:00100000:2.0:1789302136.980059:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:0.0:1789302136.980061:0:8852:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789302136.980084:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121415424:0@lo:400: 00000100:00100000:2.0:1789302136.980104:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.980135:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121415936:0@lo:400: 00000100:00100000:2.0:1789302136.980153:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.980167:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121416448:0@lo:400: 00000100:00100000:2.0:1789302136.980187:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.980198:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789302136.980202:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121415552:0@lo:400: 00000100:00100000:2.0:1789302136.980226:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.980249:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121416064:0@lo:400: 00000100:00100000:2.0:1789302136.980268:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.980295:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121415680 00000100:00100000:2.0:1789302136.980299:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121415680 00002000:00080000:0.0:1789302136.980300:0:8852:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789302136.980320:0:8852:0:(import.c:65:import_set_state_nolock()) ffff8cc382b0a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302136.980323:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121415424 00000100:00100000:2.0:1789302136.980325:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121415424 00000100:00100000:2.0:1789302136.980337:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789302136.980343:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121415680:12345-0@lo:400: 00000100:00100000:0.0:1789302136.980356:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1876219121415040:12345-0@lo:8: Request processed in 407us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.980362:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302136.980373:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121415680:12345-0@lo:400: Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.980385:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789302136.980387:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121416192 00000100:00100000:0.0:1789302136.980390:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121416192 00000100:00100000:2.0:1789302136.980396:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789302136.980402:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121415424:12345-0@lo:400: 00000100:00100000:0.0:1789302136.980403:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121416064 00000100:00100000:0.0:1789302136.980405:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121416064 00000100:00100000:0.0:1789302136.980416:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302136.980421:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121416192:12345-0@lo:400: 00000100:00100000:2.0:1789302136.980430:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121415424:12345-0@lo:400: Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.980436:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789302136.980445:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121416192:12345-0@lo:400: Request processed in 23us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.980450:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302136.980453:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302136.980460:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121416064:12345-0@lo:400: 00010000:00080000:0.0:1789302136.980477:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e60a80 x1876219121415040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302136.980484:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121416064:12345-0@lo:400: Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.980487:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:2.0:1789302136.980489:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789302136.980493:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789302136.980499:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789302136.980504:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789302136.980506:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc3839ba800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789302136.980515:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789302136.980520:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121415040:0@lo:8: 00010000:00080000:2.0:1789302136.980531:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383415180 x1876219121416064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302136.980539:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121416064:0@lo:400: 00000100:00100000:2.0:1789302136.980548:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121415424:0@lo:400: 00000100:00100000:0.0:1789302136.980551:0:10014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1876219121416576:0@lo:700: 00000100:00100000:2.0:1789302136.980567:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121415680:0@lo:400: 00010000:00080000:2.0:1789302136.980575:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383414000 x1876219121416192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302136.980576:0:10014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.980583:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121416192:0@lo:400: 00000100:00100000:0.0:1789302136.980591:0:10014:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc840 going to sleep for 11 seconds 00000004:00080000:2.0:1789302136.980600:0:10013:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789302136.980647:0:10013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 213023534027ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789302136.980653:0:10013:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789302136.980665:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121415296 00000100:00100000:1.0:1789302136.980669:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121415296 00000100:00100000:1.0:1789302136.980693:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121415808 00000100:00100000:1.0:1789302136.980697:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121415808 00000100:00100000:1.0:1789302136.980720:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121416320 00000100:00100000:1.0:1789302136.980723:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121416320 00000100:00100000:1.0:1789302136.980732:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121415936 00000100:00100000:1.0:1789302136.980735:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121415936 00000100:00100000:1.0:1789302136.980745:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121416448 00000100:00100000:1.0:1789302136.980748:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121416448 00000100:00100000:1.0:1789302136.980758:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121415552 00000100:00100000:1.0:1789302136.980760:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121415552 00000100:00100000:1.0:1789302136.980771:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789302136.980844:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302136.980848:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302136.980848:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121415296:12345-0@lo:400: 00000100:00100000:1.0:1789302136.980890:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121415296:12345-0@lo:400: Request processed in 44us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302136.980895:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789302136.980907:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789302136.980913:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121415808:12345-0@lo:400: 00000100:00100000:1.0:1789302136.980938:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121415808:12345-0@lo:400: Request processed in 26us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302136.980943:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789302136.980953:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789302136.980959:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121416320:12345-0@lo:400: 00000100:00100000:1.0:1789302136.980982:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121416320:12345-0@lo:400: Request processed in 24us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302136.980987:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789302136.980997:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789302136.981003:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121415936:12345-0@lo:400: 00000100:00100000:1.0:1789302136.981033:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121415936:12345-0@lo:400: Request processed in 30us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302136.981045:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789302136.981057:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789302136.981063:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121416448:12345-0@lo:400: 00000100:00100000:1.0:1789302136.981089:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121416448:12345-0@lo:400: Request processed in 26us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302136.981095:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789302136.981106:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789302136.981135:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121415552:12345-0@lo:400: 00000100:00100000:1.0:1789302136.981160:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121415552:12345-0@lo:400: Request processed in 50us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302136.981166:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789302136.981191:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121416576 00000100:00100000:1.0:1789302136.981195:0:8454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121416576 00000100:00100000:1.0:1789302136.981225:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302136.981240:0:8454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10014:x1876219121416576:12345-0@lo:700: 00000100:00100000:1.0:1789302136.981267:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8454:1876219121416704:0@lo:700: 00000100:00100000:1.0:1789302136.981291:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302136.981307:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7f07840 going to sleep for 11 seconds 00000020:01000000:1.0:1789302136.981321:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1789302136.981349:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789302136.981359:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.981370:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302136.981388:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789302136.981391:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4b863d000 from 39 10000000:01000000:1.0:1789302136.981393:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789302136.981416:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.981423:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.981431:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302136.981441:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121416832:0@lo:101: 00000100:00100000:1.0:1789302136.981467:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302136.981480:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7f076c0 going to sleep for 11 seconds 00010000:00080000:2.0:1789302136.982183:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383414e00 x1876219121415296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302136.982195:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121415296:0@lo:400: 00010000:00080000:2.0:1789302136.982206:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383417480 x1876219121415808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302136.982213:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121415808:0@lo:400: 00010000:00080000:2.0:1789302136.982220:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383415f80 x1876219121416320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302136.982227:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121416320:0@lo:400: 00010000:00080000:1.0:1789302136.982617:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383415500 x1876219121415552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302136.982628:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121415552:0@lo:400: 00010000:00080000:1.0:1789302136.982644:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383415880 x1876219121415936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302136.982651:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121415936:0@lo:400: 00010000:00080000:1.0:1789302136.982661:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383416d80 x1876219121416448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302136.982667:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121416448:0@lo:400: 00000100:00100000:1.0:1789302136.982698:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121416704 00000100:00100000:1.0:1789302136.982711:0:6537:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121416704 00000100:00100000:1.0:1789302136.983220:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302136.983229:0:6537:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8454:x1876219121416704:12345-0@lo:700: 00000100:00100000:1.0:1789302136.983340:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121416832 00000100:00100000:1.0:1789302136.983344:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121416832 00000100:00100000:1.0:1789302136.983626:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789302136.983634:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121416832:12345-0@lo:101: 00010000:00010000:1.0:1789302136.983643:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302136.983660:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4c2178600/0x1ff82925bd399252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39924b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.983684:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2178600/0x1ff82925bd399252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39924b expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.983698:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4c2178600/0x1ff82925bd399252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39924b expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302136.983707:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178600, rc 0) 00000100:00100000:1.0:1789302136.983791:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121416832:12345-0@lo:101: Request processed in 157us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302136.983797:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789302136.983861:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121416832:0@lo:101: 00010000:00010000:0.0:1789302136.983876:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302136.983887:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302136.983976:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121416960:0@lo:501: 00000100:00100000:0.0:1789302136.984007:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.984708:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc300 going to sleep for 11 seconds 00000100:00080000:0.0:1789302136.985144:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789302136.985391:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789302136.985453:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121416960 00000100:00100000:3.0:1789302136.985460:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121416960 00000100:00100000:3.0:1789302136.985498:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789302136.985505:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121416960:12345-0@lo:501: 00000100:00100000:3.0:1789302136.985682:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121416960:12345-0@lo:501: Request processed in 177us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302136.985689:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789302136.986079:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121416960:0@lo:501: 00000100:00100000:0.0:1789302136.986155:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417088:0@lo:503: 00000100:00100000:0.0:1789302136.986199:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.986226:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789302136.986329:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121417088 00000100:00100000:3.0:1789302136.986334:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121417088 00000100:00100000:3.0:1789302136.986354:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789302136.986361:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121417088:12345-0@lo:503: 00000100:00100000:3.0:1789302136.987078:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121417088:12345-0@lo:503: Request processed in 714us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302136.987085:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789302136.992279:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417088:0@lo:503: 00000100:00100000:0.0:1789302136.994563:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10016:1876219121417216:0@lo:502: 00000100:00100000:0.0:1789302136.994640:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.994682:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302136.994738:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121417216 00000100:00100000:2.0:1789302136.994745:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121417216 00000100:00100000:2.0:1789302136.994796:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789302136.994815:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:10016:x1876219121417216:12345-0@lo:502: 00000100:00100000:2.0:1789302136.994932:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:10016:x1876219121417216:12345-0@lo:502: Request processed in 118us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.994939:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789302136.995061:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10016:1876219121417216:0@lo:502: 00000100:00100000:0.0:1789302136.995101:0:10016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10016:1876219121417344:0@lo:502: 00000100:00100000:0.0:1789302136.995161:0:10016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302136.995175:0:10016:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852c4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302136.995427:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121417344 00000100:00100000:2.0:1789302136.995432:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121417344 00000100:00100000:2.0:1789302136.995466:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789302136.995473:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:10016:x1876219121417344:12345-0@lo:502: 00000100:00100000:2.0:1789302136.995541:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:10016:x1876219121417344:12345-0@lo:502: Request processed in 68us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.995548:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789302136.995581:0:10016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10016:1876219121417344:0@lo:502: 00000040:00080000:2.0:1789302136.995598:0:10016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789302136.995659:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789302136.995678:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302136.995686:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.995697:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302136.995706:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789302136.995709:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b863d000 from 6 10000000:01000000:2.0:1789302136.995711:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789302136.995732:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.995741:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.995760:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302136.995772:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417472:0@lo:101: 00000100:00100000:2.0:1789302136.995810:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.995826:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7ef63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302136.995837:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121417472 00000100:00100000:2.0:1789302136.995840:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121417472 00000100:00100000:2.0:1789302136.995862:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789302136.995869:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121417472:12345-0@lo:101: 00010000:00010000:2.0:1789302136.995877:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302136.995889:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd399260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399259 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.995922:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd399260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399259 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.995933:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd399260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399259 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.995942:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983400, rc 0) 00000100:00100000:2.0:1789302136.995970:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121417472:12345-0@lo:101: Request processed in 102us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.995977:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789302136.996004:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417472:0@lo:101: 00010000:00010000:2.0:1789302136.996016:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.996025:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302136.996062:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417600:0@lo:256: 00000100:00100000:2.0:1789302136.996088:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.996100:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7ef63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302136.996127:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121417600 00000100:00100000:2.0:1789302136.996131:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121417600 00000100:00100000:2.0:1789302136.996314:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789302136.996323:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121417600:12345-0@lo:256: 20000000:01000000:2.0:1789302136.996336:0:6525:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789302136.996351:0:6525:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789302136.996354:0:6525:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789302136.996425:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121417600:12345-0@lo:256: Request processed in 105us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.996432:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789302136.996459:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417600:0@lo:256: 10000000:01000000:2.0:1789302136.996496:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789302136.996502:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.996509:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302136.996516:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789302136.996518:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789302136.996521:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789302136.996533:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.996540:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.996548:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302136.996558:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417728:0@lo:101: 00000100:00100000:2.0:1789302136.996579:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.996592:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7ef63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302136.996602:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121417728 00000100:00100000:2.0:1789302136.996605:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121417728 00000100:00100000:2.0:1789302136.996621:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789302136.996626:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121417728:12345-0@lo:101: 00010000:00010000:2.0:1789302136.996638:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302136.996645:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39926e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399267 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.996658:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39926e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399267 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.996666:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39926e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399267 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.996672:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982a00, rc 0) 00000100:00100000:2.0:1789302136.996697:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121417728:12345-0@lo:101: Request processed in 70us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302136.996703:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789302136.996729:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417728:0@lo:101: 00010000:00010000:2.0:1789302136.996739:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302136.996746:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302136.996941:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417856:0@lo:501: 00000100:00100000:2.0:1789302136.996965:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.997020:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc488765240 going to sleep for 11 seconds 00000100:00100000:0.0:1789302136.997548:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121417856 00000100:00100000:0.0:1789302136.997554:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121417856 00000100:00100000:0.0:1789302136.997579:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789302136.997586:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121417856:12345-0@lo:501: 00000100:00100000:0.0:1789302136.997681:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121417856:12345-0@lo:501: Request processed in 94us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302136.997687:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789302136.999769:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417856:0@lo:501: 00000100:00100000:2.0:1789302136.999818:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417984:0@lo:503: 00000100:00100000:2.0:1789302136.999876:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302136.999948:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc488765240 going to sleep for 11 seconds 00000100:00100000:0.0:1789302137.002371:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121417984 00000100:00100000:0.0:1789302137.002384:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121417984 00000100:00100000:1.0:1789302137.002758:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789302137.002841:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121417984:12345-0@lo:503: 00000100:00100000:1.0:1789302137.003070:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121417984:12345-0@lo:503: Request processed in 301us (3192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302137.003078:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789302137.003159:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121417984:0@lo:503: 00000100:00100000:1.0:1789302137.003367:0:10017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10017:1876219121418112:0@lo:502: 00000100:00100000:1.0:1789302137.003413:0:10017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302137.003442:0:10017:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48876c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789302137.003588:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121418112 00000100:00100000:0.0:1789302137.003594:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121418112 00000100:00100000:0.0:1789302137.003625:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789302137.003632:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:10017:x1876219121418112:12345-0@lo:502: 00000100:00100000:0.0:1789302137.003710:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:10017:x1876219121418112:12345-0@lo:502: Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302137.003718:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789302137.006248:0:10017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10017:1876219121418112:0@lo:502: 00000020:01000000:1.0:1789302137.006293:0:10017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789302137.006304:0:10017:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789302137.006313:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302137.006315:0:10017:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789302137.006321:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789302137.006333:0:10017:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:01000000:1.0:1789302137.006362:0:10017:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789302137.006365:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789302137.006380:0:10017:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cc381fc19c0) 00000020:00000080:1.0:1789302137.006405:0:10017:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1789302137.006411:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789302137.006512:0:10017:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789302137.006518:0:10017:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789302137.006524:0:10017:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd39927c 00010000:00080000:1.0:1789302137.006553:0:10017:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc383a9d000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.109@tcp at head 00010000:00010000:1.0:1789302137.006788:0:10017:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1789302137.006925:0:10017:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789302137.006939:0:10017:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789302137.007107:0:10017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302137.007430:0:10017:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302137.007560:0:10017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789302137.007648:0:10017:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789302137.010568:0:10018:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302137.010575:0:10018:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 40000000:02000000:1.0:1789302137.010714:0:6537:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:00000080:0.0:1789302137.014825:0:10017:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789302137.014842:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789302137.014889:0:10017:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789302137.014914:0:10017:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd399283 00000100:00080000:0.0:1789302137.014924:0:10017:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789302137.014936:0:10017:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cc383a9d000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302137.015167:0:10017:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc485d51f80 x1876219121418240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302137.015204:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121418240:0@lo:8: 00000100:00100000:0.0:1789302137.015471:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302137.015774:0:6537:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8454:x1876219121416704:12345-0@lo:700: Request processed in 32544us (34479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302137.015785:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789302137.015839:0:8454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e62d80 x1876219121416704/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789302152 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302137.015854:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8454:1876219121416704:0@lo:700: 40000000:02000000:1.0:1789302137.015867:0:8454:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00080000:0.0:1789302137.016177:0:10017:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789302137.016593:0:10017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302137.016601:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302137.016603:0:10017:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789302137.016608:0:10017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302137.016612:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302137.016613:0:10017:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789302137.016616:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789302137.016618:0:10017:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789302137.016645:0:10017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10017:1876219121418368:0@lo:502: 00000100:00100000:0.0:1789302137.016701:0:10017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302137.016726:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121418368 00000100:00100000:0.0:1789302137.016731:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121418368 00000100:00100000:0.0:1789302137.016765:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789302137.016773:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:10017:x1876219121418368:12345-0@lo:502: 00000100:00100000:0.0:1789302137.016868:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:10017:x1876219121418368:12345-0@lo:502: Request processed in 95us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302137.016874:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789302137.016907:0:10017:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852c4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302137.016922:0:10017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10017:1876219121418368:0@lo:502: 00000020:01000000:0.0:1789302137.016943:0:10017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302137.016946:0:10017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302137.016948:0:10017:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789302137.016967:0:10017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:3.0:1789302137.017139:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121418240 00000100:00100000:3.0:1789302137.017149:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121418240 00000100:00100000:3.0:1789302137.017172:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789302137.017177:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876219121418240:12345-0@lo:8: 00010000:00080000:3.0:1789302137.017200:0:8852:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:3.0:1789302137.017245:0:8852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd39928a 00002000:00100000:3.0:1789302137.017258:0:8852:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cc383808000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789302137.017262:0:8852:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789302137.017466:0:8852:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789302137.017706:0:8852:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789302137.017729:0:8852:0:(import.c:65:import_set_state_nolock()) ffff8cc38380a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302137.017776:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876219121418240:12345-0@lo:8: Request processed in 597us (2306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302137.017782:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789302137.017834:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d51f80 x1876219121418240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302137.017844:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789302137.017849:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789302137.017856:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789302137.017861:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789302137.017863:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc383a9d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789302137.017872:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789302137.017876:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121418240:0@lo:8: 00000004:00080000:3.0:1789302137.017897:0:10018:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789302137.017942:0:10018:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 213060828591ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789302137.017948:0:10018:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:1.0:1789302137.021300:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1789302137.021335:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789302137.021344:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302137.021354:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302137.021362:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789302137.021363:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cc4ac2ab380 from 1 10000000:01000000:1.0:1789302137.021366:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789302137.021391:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302137.021397:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302137.021405:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302137.021421:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121418496:0@lo:101: 00000100:00100000:1.0:1789302137.021473:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302137.021500:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48876ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302137.021515:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121418496 00000100:00100000:1.0:1789302137.021519:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121418496 00000100:00100000:1.0:1789302137.021556:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789302137.021561:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121418496:12345-0@lo:101: 00010000:00010000:1.0:1789302137.021571:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302137.021592:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399291 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302137.021610:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399291 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302137.021617:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399291 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302137.021623:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3400, rc 0) 00000100:00100000:1.0:1789302137.021659:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121418496:12345-0@lo:101: Request processed in 97us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302137.021663:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789302137.021697:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121418496:0@lo:101: 00010000:00010000:1.0:1789302137.021707:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302137.021714:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302137.021764:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121418624:0@lo:501: 00000100:00100000:1.0:1789302137.021784:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302137.021796:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48876ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302137.021806:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121418624 00000100:00100000:1.0:1789302137.021809:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121418624 00000100:00100000:1.0:1789302137.021826:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789302137.021837:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48534b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121418624:12345-0@lo:501: 00000100:00100000:1.0:1789302137.021890:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48534b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121418624:12345-0@lo:501: Request processed in 54us (105us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302137.021895:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789302137.021918:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121418624:0@lo:501: 10000000:01000000:1.0:1789302137.021933:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789302137.021936:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302137.021941:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302137.029761:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789302137.035317:0:10019:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789302137.035335:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302137.035348:0:10019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10019:1876219121418880:0@lo:7: 00000100:00100000:3.0:1789302137.035349:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121418752:0@lo:13: 00000100:00100000:3.0:1789302137.035556:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:3.0:1789302137.036206:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789302137.036213:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789302137.037285:0:8454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10014:x1876219121416576:12345-0@lo:700: Request processed in 56050us (56703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302137.037297:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789302137.037456:0:10014:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d53b80 x1876219121416576/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789302152 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302137.037473:0:10014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1876219121416576:0@lo:700: 00000100:00100000:0.0:1789302137.038402:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121418752 00000100:00100000:0.0:1789302137.038411:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121418752 00000100:00100000:0.0:1789302137.038481:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302137.038492:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121418752:12345-0@lo:13: 00002000:00000024:0.0:1789302137.038521:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1789302137.038576:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121418752:12345-0@lo:13: Request processed in 86us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302137.038584:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302137.038609:0:10019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302137.038640:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121418880 00000100:00100000:1.0:1789302137.038713:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121418880 00010000:00080000:3.0:1789302137.038720:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e62d80 x1876219121418752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302137.038739:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121418752:0@lo:13: 00000100:00100000:1.0:1789302137.038742:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302137.038748:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10019:x1876219121418880:12345-0@lo:7: 00000100:00080000:2.0:1789302137.039682:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302137.040450:0:10019:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48876ca80 going to sleep for 11 seconds 00002000:00080000:1.0:1789302137.044367:0:8446:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789302137.044376:0:8446:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789302137.044519:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10019:x1876219121418880:12345-0@lo:7: Request processed in 5766us (5905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302137.044529:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789302137.044601:0:10019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e60700 x1876219121418880/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789302153 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302137.044628:0:10019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10019:1876219121418880:0@lo:7: 00000004:00080000:0.0:1789302137.044643:0:10019:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789302137.044681:0:10019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10019:1876219121419008:0@lo:5: 00000100:00100000:0.0:1789302137.044717:0:10019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302137.044782:0:10019:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302137.044820:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121419008 00000100:00100000:1.0:1789302137.044826:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121419008 00000100:00100000:1.0:1789302137.044905:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302137.044921:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10019:x1876219121419008:12345-0@lo:5: 00002000:00080000:1.0:1789302137.044946:0:8852:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789302137.044949:0:8852:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789302137.045304:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10019:x1876219121419008:12345-0@lo:5: Request processed in 385us (585us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789302137.045311:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:3.0:1789302137.045416:0:10014:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789302137.045432:0:10014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd96b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1876219121419264:0@lo:7: 00000100:00100000:3.0:1789302137.045463:0:10014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302137.046921:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121419136:0@lo:13: 00000100:00100000:2.0:1789302137.047109:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302137.047337:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121419136 00000100:00100000:2.0:1789302137.047345:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121419136 00000100:00100000:2.0:1789302137.047392:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789302137.047400:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121419136:12345-0@lo:13: 00002000:00000024:2.0:1789302137.047444:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789302137.047902:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121419136:12345-0@lo:13: Request processed in 501us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302137.047911:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789302137.047958:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd968700 x1876219121419136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302137.047990:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121419136:0@lo:13: 00000100:00100000:0.0:1789302137.048569:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121419264 00000100:00100000:0.0:1789302137.048576:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121419264 00000100:00100000:3.0:1789302137.048588:0:10014:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3839c5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302137.048622:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302137.048632:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10014:x1876219121419264:12345-0@lo:7: 00010000:00080000:1.0:1789302137.049259:0:10019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d52680 x1876219121419008/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302153 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302137.049273:0:10019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10019:1876219121419008:0@lo:5: 00000004:00080000:1.0:1789302137.049284:0:10019:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789302137.049317:0:10019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383807480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10019:1876219121419392:0@lo:700: 00000100:00100000:1.0:1789302137.049361:0:10019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302137.049389:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121419392 00000100:00100000:1.0:1789302137.049393:0:8453:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121419392 00000100:00100000:1.0:1789302137.049427:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302137.049435:0:8453:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10019:x1876219121419392:12345-0@lo:700: 00000100:00100000:1.0:1789302137.049529:0:10019:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6d80 going to sleep for 11 seconds 00002000:00080000:1.0:1789302137.053502:0:8445:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789302137.053510:0:8445:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789302137.053645:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10014:x1876219121419264:12345-0@lo:7: Request processed in 5010us (8176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302137.053656:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789302137.053726:0:10014:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd96b480 x1876219121419264/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789302153 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302137.053742:0:10014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd96b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1876219121419264:0@lo:7: 00000004:00080000:0.0:1789302137.053755:0:10014:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789302137.053791:0:10014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1876219121419520:0@lo:5: 00000100:00100000:0.0:1789302137.053826:0:10014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302137.053886:0:10014:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302137.053931:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121419520 00000100:00100000:1.0:1789302137.053937:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121419520 00000100:00100000:1.0:1789302137.054017:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789302137.054027:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10014:x1876219121419520:12345-0@lo:5: 00002000:00080000:1.0:1789302137.054050:0:8852:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789302137.054105:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10014:x1876219121419520:12345-0@lo:5: Request processed in 79us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302137.054214:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789302137.054301:0:10014:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d53b80 x1876219121419520/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302153 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302137.054313:0:10014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1876219121419520:0@lo:5: 00000004:00080000:2.0:1789302137.054322:0:10014:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789302137.054346:0:10014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1876219121419648:0@lo:5: 00000100:00100000:2.0:1789302137.054374:0:10014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302137.054409:0:10014:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc488765240 going to sleep for 11 seconds 00000100:00100000:0.0:1789302137.054427:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121419648 00000100:00100000:0.0:1789302137.054433:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121419648 00000100:00100000:0.0:1789302137.054464:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302137.054473:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10014:x1876219121419648:12345-0@lo:5: 00002000:00080000:0.0:1789302137.054497:0:8447:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1789302137.056434:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:10014:x1876219121419648:12345-0@lo:5: Request processed in 1958us (2054us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789302137.056444:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789302137.058054:0:10014:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a17800 x1876219121419648/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302153 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302137.058073:0:10014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1876219121419648:0@lo:5: 00000004:00080000:2.0:1789302137.058089:0:10014:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789302137.058146:0:10014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10014:1876219121419776:0@lo:900: 00000100:00100000:2.0:1789302137.058209:0:10014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302137.058247:0:10014:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc488765240 going to sleep for 11 seconds 00000100:00100000:1.0:1789302137.058258:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121419776 00000100:00100000:1.0:1789302137.058266:0:6542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121419776 00000100:00100000:1.0:1789302137.058322:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302137.058331:0:6542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10014:x1876219121419776:12345-0@lo:900: 00000100:00100000:1.0:1789302137.058400:0:6542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10014:x1876219121419776:12345-0@lo:900: Request processed in 69us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302137.058408:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789302137.058534:0:10014:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a14700 x1876219121419776/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789302153 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302137.058543:0:10014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10014:1876219121419776:0@lo:900: 00000001:00080000:2.0:1789302137.068713:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:2.0:1789302137.068735:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1789302137.069047:0:8453:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10019:x1876219121419392:12345-0@lo:700: Request processed in 19608us (19681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302137.069060:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789302137.069397:0:10019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383807480 x1876219121419392/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789302153 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302137.069421:0:10019:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789302137.069440:0:10019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383807480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10019:1876219121419392:0@lo:700: 00000004:02000040:1.0:1789302137.075041:0:10019:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1789302137.080428:0:10019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383804000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10019:1876219121419904:0@lo:5: 00000100:00100000:1.0:1789302137.080559:0:10019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302137.080666:0:10019:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789302137.080854:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121419904 00000100:00100000:0.0:1789302137.080863:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121419904 00000100:00100000:0.0:1789302137.081131:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789302137.081142:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10019:x1876219121419904:12345-0@lo:5: 00002000:00080000:2.0:1789302137.094540:0:8446:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789302137.094561:0:8446:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00010000:00080000:1.0:1789302137.098895:0:10019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383804000 x1876219121419904/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302153 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302137.098926:0:10019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383804000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10019:1876219121419904:0@lo:5: 00000004:00080000:1.0:1789302137.098942:0:10019:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:2.0:1789302137.099192:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10019:x1876219121419904:12345-0@lo:5: Request processed in 17336us (17917us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789302137.099202:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1789302137.237743:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789302137.370611:0:10050:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789302137.370920:0:10050:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789302137.941476:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302137.941506:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121420032:0@lo:41: 00000100:00100000:3.0:1789302137.941623:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302137.941748:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121420032 00000100:00100000:1.0:1789302137.941757:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121420032 00000100:00100000:1.0:1789302137.941825:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789302137.941844:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121420032:12345-0@lo:41: 00000004:00000024:1.0:1789302137.941882:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789302137.941927:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121420032:12345-0@lo:41: Request processed in 94us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302137.941942:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789302137.942592:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121420032:0@lo:41: 00000020:00000004:2.0:1789302138.014745:0:10098:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789302138.014755:0:10098:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1789302138.260275:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302138.513895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302138.514569:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101446272 00000100:00100000:0.0:1789302138.514581:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101446272 00000100:00100000:0.0:1789302138.514676:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 181 00000100:00100000:0.0:1789302138.514685:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2395:x1876219101446272:12345-192.168.203.9@tcp:250: 00010000:00080000:0.0:1789302138.514715:0:6523:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 60e561d9-781c-4e5b-be29-fcae8ab02e31@192.168.203.9@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:0.0:1789302138.514746:0:6523:0:(genops.c:1384:class_connect()) connect: client 60e561d9-781c-4e5b-be29-fcae8ab02e31, cookie 0x1ff82925bd39929f 00000100:00080000:0.0:1789302138.514891:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8cc383a9b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302138.514981:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+5:2395:x1876219101446272:12345-192.168.203.9@tcp:250: Request processed in 295us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302138.514988:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 181 00000100:00100000:3.0:1789302138.523712:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302138.524067:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101446400 00000100:00100000:1.0:1789302138.524078:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101446400 00000100:00100000:1.0:1789302138.524165:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 182 00000100:00100000:1.0:1789302138.524175:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4883a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+5:6154:x1876219101446400:12345-192.168.203.9@tcp:101: 00010000:00010000:1.0:1789302138.524191:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302138.524209:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4addd2200/0x1ff82925bd3992a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a58d0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302138.524850:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4addd2200/0x1ff82925bd3992a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d0 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302138.524862:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4addd2200/0x1ff82925bd3992a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d0 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302138.524871:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2200, rc 0) 00000100:00100000:1.0:1789302138.524927:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4883a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+6:6154:x1876219101446400:12345-192.168.203.9@tcp:101: Request processed in 753us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302138.524934:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 182 00000100:00100000:3.0:1789302138.529377:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302138.529538:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101446528 00000100:00100000:0.0:1789302138.529549:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101446528 00000100:00100000:0.0:1789302138.529606:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 183 00000100:00100000:0.0:1789302138.529617:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4883a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+6:6154:x1876219101446528:12345-192.168.203.9@tcp:501: 00000100:00100000:0.0:1789302138.529776:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4883a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+6:6154:x1876219101446528:12345-192.168.203.9@tcp:501: Request processed in 160us (408us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302138.529785:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 183 00000100:00100000:0.0:1789302138.545268:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302138.545350:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101446656 00000100:00100000:1.0:1789302138.545360:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101446656 00000100:00100000:1.0:1789302138.545410:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 184 00000100:00100000:1.0:1789302138.545421:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+6:6154:x1876219101446656:12345-192.168.203.9@tcp:101: 00010000:00010000:1.0:1789302138.545436:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302138.545462:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4addd3e00/0x1ff82925bd3992ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a58d7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302138.545504:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4addd3e00/0x1ff82925bd3992ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d7 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302138.545515:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4addd3e00/0x1ff82925bd3992ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d7 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302138.545525:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3e00, rc 0) 00000100:00100000:1.0:1789302138.545583:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+7:6154:x1876219101446656:12345-192.168.203.9@tcp:101: Request processed in 163us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302138.545589:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 184 00000100:00100000:1.0:1789302138.552428:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302138.552974:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101446784 00000100:00100000:3.0:1789302138.552984:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101446784 00000100:00100000:3.0:1789302138.553037:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 185 00000100:00100000:3.0:1789302138.553047:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+7:6154:x1876219101446784:12345-192.168.203.9@tcp:501: 00000100:00100000:3.0:1789302138.553234:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:6154:x1876219101446784:12345-192.168.203.9@tcp:501: Request processed in 188us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302138.553242:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 185 00000100:00100000:3.0:1789302138.565302:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302138.565436:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101446912 00000100:00100000:0.0:1789302138.565471:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101446912 00000100:00100000:0.0:1789302138.565529:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 186 00000100:00100000:0.0:1789302138.565538:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:6154:x1876219101446912:12345-192.168.203.9@tcp:503: 00000100:00100000:0.0:1789302138.565685:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:6154:x1876219101446912:12345-192.168.203.9@tcp:503: Request processed in 147us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302138.565693:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 186 00000100:00100000:0.0:1789302138.578417:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302138.578567:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101447040 00000100:00100000:1.0:1789302138.578579:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101447040 00000100:00100000:1.0:1789302138.578634:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 187 00000100:00100000:1.0:1789302138.578653:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:6172:x1876219101447040:12345-192.168.203.9@tcp:502: 00000100:00100000:1.0:1789302138.578812:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:6172:x1876219101447040:12345-192.168.203.9@tcp:502: Request processed in 168us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302138.578820:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 187 00000100:00100000:1.0:1789302138.642356:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302138.642856:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101447168 00000100:00100000:3.0:1789302138.642884:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101447168 00000100:00100000:3.0:1789302138.642955:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 188 00000100:00100000:3.0:1789302138.642967:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:6172:x1876219101447168:12345-192.168.203.9@tcp:502: 00000100:00100000:3.0:1789302138.643400:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:6172:x1876219101447168:12345-192.168.203.9@tcp:502: Request processed in 434us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302138.643408:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 188 00000100:00100000:3.0:1789302138.649621:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302138.649793:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101447296 00000100:00100000:0.0:1789302138.649803:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101447296 00000100:00100000:0.0:1789302138.649854:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 189 00000100:00100000:0.0:1789302138.649863:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:6154:x1876219101447296:12345-192.168.203.9@tcp:101: 00010000:00010000:0.0:1789302138.649879:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302138.649896:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538ea00/0x1ff82925bd3992b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5908 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302138.649923:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538ea00/0x1ff82925bd3992b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5908 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302138.649933:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538ea00/0x1ff82925bd3992b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5908 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302138.649942:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538ea00, rc 0) 00000100:00100000:0.0:1789302138.649996:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6154:x1876219101447296:12345-192.168.203.9@tcp:101: Request processed in 134us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302138.650002:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 189 00000100:00100000:0.0:1789302138.663371:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302138.663654:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101447424 00000100:00100000:3.0:1789302138.663665:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101447424 00000100:00100000:3.0:1789302138.663721:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 190 00000100:00100000:3.0:1789302138.663732:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6154:x1876219101447424:12345-192.168.203.9@tcp:256: 20000000:01000000:3.0:1789302138.663757:0:6524:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789302138.663783:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789302138.663787:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789302138.663791:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789302138.663793:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789302138.663796:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789302138.665459:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6154:x1876219101447424:12345-192.168.203.9@tcp:256: Request processed in 1709us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302138.665472:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 190 00000100:00100000:1.0:1789302138.668534:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302138.668701:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101447552 00000100:00100000:2.0:1789302138.668714:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101447552 00000100:00100000:2.0:1789302138.668822:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 191 00000100:00100000:2.0:1789302138.668832:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6154:x1876219101447552:12345-192.168.203.9@tcp:101: 00010000:00010000:2.0:1789302138.668863:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302138.668882:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd3992bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a590f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302138.668922:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd3992bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a590f expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302138.668933:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd3992bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a590f expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302138.668942:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982000, rc 0) 00000100:00100000:2.0:1789302138.669001:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6154:x1876219101447552:12345-192.168.203.9@tcp:101: Request processed in 171us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302138.669008:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 191 00000100:00100000:3.0:1789302138.670546:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302138.672969:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101447680 00000100:00100000:0.0:1789302138.672987:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101447680 00000100:00100000:0.0:1789302138.673060:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 192 00000100:00100000:0.0:1789302138.673069:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6154:x1876219101447680:12345-192.168.203.9@tcp:501: 00000100:00100000:0.0:1789302138.673268:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6154:x1876219101447680:12345-192.168.203.9@tcp:501: Request processed in 199us (2726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302138.673275:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 192 00000100:00100000:3.0:1789302138.676299:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302138.677784:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101447808 00000100:00100000:0.0:1789302138.677797:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101447808 00000100:00100000:0.0:1789302138.677846:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 193 00000100:00100000:0.0:1789302138.677855:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6154:x1876219101447808:12345-192.168.203.9@tcp:503: 00000100:00100000:0.0:1789302138.678071:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6154:x1876219101447808:12345-192.168.203.9@tcp:503: Request processed in 215us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302138.678078:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 193 00000100:00100000:3.0:1789302138.681275:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302138.682611:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101447936 00000100:00100000:0.0:1789302138.682626:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101447936 00000100:00100000:0.0:1789302138.682686:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 194 00000100:00100000:0.0:1789302138.682697:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6177:x1876219101447936:12345-192.168.203.9@tcp:502: 00000100:00100000:0.0:1789302138.682861:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6177:x1876219101447936:12345-192.168.203.9@tcp:502: Request processed in 165us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302138.682869:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 194 00000100:00100000:3.0:1789302138.685613:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302138.685729:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101448064 00000100:00100000:0.0:1789302138.685739:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101448064 00000100:00100000:0.0:1789302138.685794:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 195 00000100:00100000:0.0:1789302138.685803:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6177:x1876219101448064:12345-192.168.203.9@tcp:502: 00000100:00100000:0.0:1789302138.685953:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6177:x1876219101448064:12345-192.168.203.9@tcp:502: Request processed in 150us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302138.685960:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 195 00000100:00100000:3.0:1789302138.691551:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302138.691598:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302138.691891:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101448192 00000100:00100000:1.0:1789302138.691914:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101448192 00000100:00100000:1.0:1789302138.691964:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101448448 00000100:00100000:1.0:1789302138.691980:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101448448 00000100:00100000:1.0:1789302138.692007:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:1.0:1789302138.692015:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1876219101448192:12345-192.168.203.9@tcp:38: 00010000:00080000:1.0:1789302138.692046:0:6532:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1789302138.692102:0:6532:0:(genops.c:1384:class_connect()) connect: client c76ee310-c3b4-4286-aaea-77936c269d98, cookie 0x1ff82925bd3992c2 00000004:00100000:1.0:1789302138.692171:0:6532:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789302138.692442:0:6532:0:(import.c:65:import_set_state_nolock()) ffff8cc3839be000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302138.692508:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2395:x1876219101448192:12345-192.168.203.9@tcp:38: Request processed in 491us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302138.692516:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:1.0:1789302138.692536:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 8 00000100:00100000:1.0:1789302138.692541:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1876219101448448:12345-192.168.203.9@tcp:38: 00010000:00080000:1.0:1789302138.692557:0:6532:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1789302138.692588:0:6532:0:(genops.c:1384:class_connect()) connect: client c76ee310-c3b4-4286-aaea-77936c269d98, cookie 0x1ff82925bd3992c9 00000004:00100000:1.0:1789302138.692600:0:6532:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789302138.692761:0:6532:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7ef5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302138.692802:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2395:x1876219101448448:12345-192.168.203.9@tcp:38: Request processed in 244us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302138.692809:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 8 00010000:00010000:3.0:1789302139.287313:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302139.710548:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302139.710588:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302139.710617:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302139.710693:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101448704 00000100:00100000:2.0:1789302139.710703:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101448704 00000100:00100000:2.0:1789302139.710773:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101448320 00000100:00100000:2.0:1789302139.710777:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101448320 00000100:00100000:2.0:1789302139.710792:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101448576 00000100:00100000:2.0:1789302139.710794:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101448576 00000100:00100000:2.0:1789302139.710813:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 9 00000100:00100000:2.0:1789302139.710821:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+7:6154:x1876219101448704:12345-192.168.203.9@tcp:41: 00000004:00000024:2.0:1789302139.710857:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789302139.710923:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+7:6154:x1876219101448704:12345-192.168.203.9@tcp:41: Request processed in 101us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302139.710929:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 9 00000100:00100000:2.0:1789302139.710946:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 10 00000100:00100000:2.0:1789302139.710953:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:0:x1876219101448320:12345-192.168.203.9@tcp:41: 00000004:00000024:2.0:1789302139.710976:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789302139.710998:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:0:x1876219101448320:12345-192.168.203.9@tcp:41: Request processed in 47us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302139.711004:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 10 00000100:00100000:2.0:1789302139.711015:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 11 00000100:00100000:2.0:1789302139.711022:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:0:x1876219101448576:12345-192.168.203.9@tcp:41: 00000004:00000024:2.0:1789302139.711037:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789302139.711060:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:0:x1876219101448576:12345-192.168.203.9@tcp:41: Request processed in 39us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302139.711066:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 11 00000100:00080000:3.0:1789302139.711199:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789302139.711210:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302139.713362:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302139.717647:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101448832 00000100:00100000:2.0:1789302139.717662:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101448832 00000100:00100000:2.0:1789302139.717791:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:2.0:1789302139.717803:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:6154:x1876219101448832:12345-192.168.203.9@tcp:40: 00000100:00100000:2.0:1789302139.717965:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:6154:x1876219101448832:12345-192.168.203.9@tcp:40: Request processed in 165us (4611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302139.717974:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:3.0:1789302139.724567:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302139.724683:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302139.724723:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302139.724782:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101449216 00000100:00100000:2.0:1789302139.724792:0:6542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101449216 00000100:00100000:2.0:1789302139.724861:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4 00000100:00100000:2.0:1789302139.724872:0:6542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c76ee310-c3b4-4286-aaea-77936c269d98+6:6154:x1876219101449216:12345-192.168.203.9@tcp:900: 00000100:00100000:2.0:1789302139.724959:0:6542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c76ee310-c3b4-4286-aaea-77936c269d98+6:6154:x1876219101449216:12345-192.168.203.9@tcp:900: Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302139.724966:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4 00000100:00100000:3.0:1789302139.726799:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302139.726819:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101448960 00000100:00100000:1.0:1789302139.726828:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101448960 00000100:00100000:1.0:1789302139.726863:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101449088 00000100:00100000:1.0:1789302139.726867:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101449088 00000100:00100000:1.0:1789302139.726883:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00100000:1.0:1789302139.726891:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1876219101448960:12345-192.168.203.9@tcp:8: 00000100:00100000:3.0:1789302139.726921:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:3.0:1789302139.726926:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2395:x1876219101449088:12345-192.168.203.9@tcp:8: 00010000:00080000:1.0:1789302139.726931:0:8445:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp t0 exp 0000000000000000 cur 215 last 0 00010000:00080000:3.0:1789302139.726940:0:8852:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1789302139.726966:0:8852:0:(genops.c:1384:class_connect()) connect: client c76ee310-c3b4-4286-aaea-77936c269d98, cookie 0x1ff82925bd3992d7 00000020:00000080:1.0:1789302139.726966:0:8445:0:(genops.c:1384:class_connect()) connect: client c76ee310-c3b4-4286-aaea-77936c269d98, cookie 0x1ff82925bd3992d0 00002000:00100000:3.0:1789302139.726977:0:8852:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c76ee310-c3b4-4286-aaea-77936c269d98/ffff8cc38380c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789302139.726995:0:8852:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789302139.727064:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101449344 00000100:00100000:2.0:1789302139.727073:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101449344 00000100:00100000:2.0:1789302139.727107:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 196 00002000:00080000:3.0:1789302139.727171:0:8852:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00100000:1.0:1789302139.727194:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c76ee310-c3b4-4286-aaea-77936c269d98/ffff8cc4b7ef7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00080000:3.0:1789302139.727198:0:8852:0:(import.c:65:import_set_state_nolock()) ffff8cc38380e800 : changing import state from RECOVER to FULL 00002000:00100000:1.0:1789302139.727205:0:8445:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789302139.727339:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2395:x1876219101449088:12345-192.168.203.9@tcp:8: Request processed in 409us (2614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302139.727348:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:3.0:1789302139.727993:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302139.728041:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101449472 00000100:00100000:3.0:1789302139.728047:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101449472 00000100:00100000:3.0:1789302139.728079:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 0 00000100:00100000:3.0:1789302139.728087:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:6154:x1876219101449472:12345-192.168.203.9@tcp:33: 00000100:00100000:2.0:1789302139.729043:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2399:x1876219101449344:12345-192.168.203.9@tcp:400: 00000100:00100000:2.0:1789302139.729234:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2399:x1876219101449344:12345-192.168.203.9@tcp:400: Request processed in 1992us (2313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302139.729246:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 196 00002000:00080000:1.0:1789302139.730165:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789302139.730203:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7ef4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302139.730270:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2395:x1876219101448960:12345-192.168.203.9@tcp:8: Request processed in 3378us (5713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302139.730279:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 16 00000004:00080000:3.0:1789302139.743672:0:6533:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15485us 00000004:00200000:3.0:1789302139.766277:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789302139.766389:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:6154:x1876219101449472:12345-192.168.203.9@tcp:33: Request processed in 38297us (38392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302139.766409:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 0 00000100:00100000:2.0:1789302139.969428:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302139.969839:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101449600 00000100:00100000:0.0:1789302139.969850:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101449600 00000100:00100000:0.0:1789302139.969964:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:0.0:1789302139.969976:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:6195:x1876219101449600:12345-192.168.203.9@tcp:101: 00010000:00010000:0.0:1789302139.969997:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302139.970074:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd3992de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5940 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302139.970171:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd3992e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302139.970186:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd3992e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302139.970200:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd3992e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302139.970263:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789302139.970267:0:9541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789302139.970292:0:9541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd3992e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302139.970320:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd3992de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5940 expref: 8 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302139.970339:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd3992e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5940 expref: 7 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302139.970347:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc38392eb00) 00010000:00010000:0.0:1789302139.970350:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302139.970370:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538e800, rc 0) 00000100:00100000:0.0:1789302139.970544:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:6195:x1876219101449600:12345-192.168.203.9@tcp:101: Request processed in 570us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302139.970562:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 13 00010000:00010000:2.0:1789302140.308974:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302140.505663:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302140.505703:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121420160:0@lo:13: 00000100:00100000:0.0:1789302140.508197:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302140.508309:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121420288:0@lo:13: 00000100:00100000:0.0:1789302140.508382:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302140.508728:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121420160 00000100:00100000:1.0:1789302140.508737:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121420160 00000100:00100000:1.0:1789302140.508817:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121420288 00000100:00100000:1.0:1789302140.508820:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121420288 00000100:00100000:1.0:1789302140.508844:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789302140.508853:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121420160:12345-0@lo:13: 00002000:00000024:1.0:1789302140.508875:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302140.508925:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121420160:12345-0@lo:13: Request processed in 72us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302140.508931:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789302140.508946:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789302140.508952:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121420288:12345-0@lo:13: 00002000:00000024:1.0:1789302140.508962:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302140.508985:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121420288:12345-0@lo:13: Request processed in 33us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302140.508990:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789302140.511452:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302140.511510:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a17100 x1876219121420288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302140.511534:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121420288:0@lo:13: 00010000:00080000:0.0:1789302140.511548:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383805f80 x1876219121420160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302140.511559:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121420160:0@lo:13: 00010000:00010000:1.0:1789302141.332307:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302142.036536:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121420544:0@lo:400: 00000100:00100000:1.0:1789302142.036674:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.036735:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121421056:0@lo:400: 00000100:00100000:1.0:1789302142.036765:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.036782:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121421568:0@lo:400: 00000100:00100000:1.0:1789302142.036804:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.036818:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121422080:0@lo:400: 00000100:00100000:1.0:1789302142.036834:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.036854:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789302142.036860:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121420416:0@lo:41: 00000100:00100000:1.0:1789302142.036889:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.036909:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121420928:0@lo:400: 00000100:00100000:1.0:1789302142.036934:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.036951:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121421440:0@lo:400: 00000100:00100000:1.0:1789302142.036971:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.036987:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121421952:0@lo:400: 00000100:00100000:1.0:1789302142.037012:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.037065:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121421568 00000100:00100000:1.0:1789302142.037072:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121421568 00000100:00100000:1.0:1789302142.037148:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121422080 00000100:00100000:1.0:1789302142.037152:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121422080 00000100:00100000:1.0:1789302142.037173:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121421440 00000100:00100000:1.0:1789302142.037176:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121421440 00000100:00100000:2.0:1789302142.037351:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121420544 00000100:00100000:2.0:1789302142.037356:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121420544 00000100:00100000:2.0:1789302142.037392:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789302142.037402:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121420544:12345-0@lo:400: 00000100:00100000:1.0:1789302142.037428:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121421952 00000100:00100000:1.0:1789302142.037433:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121421952 00000100:00100000:1.0:1789302142.037455:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302142.037481:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121420544:12345-0@lo:400: Request processed in 80us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302142.037489:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789302142.037522:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121421056 00000100:00100000:2.0:1789302142.037526:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121421056 00000100:00100000:2.0:1789302142.037548:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121420416 00000100:00100000:2.0:1789302142.037552:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121420416 00000100:00100000:1.0:1789302142.037564:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121421568:12345-0@lo:400: 00000100:00100000:2.0:1789302142.037570:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789302142.037579:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121421056:12345-0@lo:400: 00000100:00100000:1.0:1789302142.037607:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121421568:12345-0@lo:400: Request processed in 47us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302142.037624:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121421056:12345-0@lo:400: Request processed in 44us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302142.037624:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302142.037634:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789302142.037642:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302142.037651:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121422080:12345-0@lo:400: 00000100:00100000:2.0:1789302142.037654:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789302142.037667:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121420416:12345-0@lo:41: 00000004:00000024:2.0:1789302142.037692:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789302142.037692:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121422080:12345-0@lo:400: Request processed in 42us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302142.037700:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302142.037715:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302142.037722:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121421440:12345-0@lo:400: 00000100:00100000:2.0:1789302142.037757:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121420416:12345-0@lo:41: Request processed in 91us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302142.037764:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121421440:12345-0@lo:400: Request processed in 41us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302142.037769:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789302142.037776:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302142.037794:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302142.037801:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121421952:12345-0@lo:400: 00000100:00100000:1.0:1789302142.037832:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121421952:12345-0@lo:400: Request processed in 32us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302142.037840:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302142.037863:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121420928 00000100:00100000:1.0:1789302142.037866:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121420928 00000100:00100000:1.0:1789302142.037891:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789302142.037898:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121420928:12345-0@lo:400: 00000100:00100000:1.0:1789302142.037926:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121420928:12345-0@lo:400: Request processed in 29us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302142.037932:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789302142.038046:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121420672:0@lo:400: 00000100:00100000:1.0:1789302142.038080:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.038138:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121421184:0@lo:400: 00000100:00100000:1.0:1789302142.038166:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.038184:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121421696:0@lo:400: 00000100:00080000:0.0:1789302142.038353:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302142.038358:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302142.038368:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121420672 00000100:00100000:0.0:1789302142.038373:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121420672 00000100:00100000:0.0:1789302142.038400:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121421184 00000100:00100000:0.0:1789302142.038403:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121421184 00000100:00100000:0.0:1789302142.038424:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302142.038430:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121420672:12345-0@lo:400: 00000100:00100000:0.0:1789302142.038467:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121420672:12345-0@lo:400: Request processed in 37us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302142.038473:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302142.038493:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789302142.038499:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121421184:12345-0@lo:400: 00000100:00100000:0.0:1789302142.038528:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121421184:12345-0@lo:400: Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302142.038534:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1789302142.038548:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302142.038560:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121420800:0@lo:400: 00000100:00100000:1.0:1789302142.038584:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302142.038595:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.038626:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121420672:0@lo:400: 00000100:00100000:0.0:1789302142.038628:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121421312:0@lo:400: 00000100:00100000:0.0:1789302142.038649:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302142.038665:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121421824:0@lo:400: 00000100:00100000:1.0:1789302142.038690:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121421184:0@lo:400: 00000100:00100000:2.0:1789302142.038712:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121420416:0@lo:41: 00000100:00100000:1.0:1789302142.038721:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121421696 00000100:00100000:1.0:1789302142.038726:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121421696 00000100:00100000:3.0:1789302142.038742:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121421312 00000100:00100000:3.0:1789302142.038748:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121421312 00000100:00100000:1.0:1789302142.038756:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789302142.038765:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121421696:12345-0@lo:400: 00000100:00100000:3.0:1789302142.038777:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789302142.038786:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121421312:12345-0@lo:400: 00000100:00100000:0.0:1789302142.044611:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789302142.044675:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302142.044682:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302142.044696:0:6530:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789302142.044706:0:6530:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789302142.046030:0:9541:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789302142.046050:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121421824 00000100:00100000:0.0:1789302142.046060:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121421824 00000100:00100000:0.0:1789302142.046123:0:9541:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789302142.046133:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789302142.046144:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121421824:12345-0@lo:400: 00000100:00100000:0.0:1789302142.046242:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121421824:12345-0@lo:400: Request processed in 100us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302142.046260:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789302142.046282:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789302142.046294:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121420800 00000100:00100000:0.0:1789302142.046299:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121420800 00000100:00100000:0.0:1789302142.046346:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789302142.046354:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121420800:12345-0@lo:400: 00000100:00100000:0.0:1789302142.046391:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121420800:12345-0@lo:400: Request processed in 39us (7796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302142.046397:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789302142.046436:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121420800:0@lo:400: 00010000:00080000:0.0:1789302142.046452:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd801f80 x1876219121421824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302142.046462:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121421824:0@lo:400: 00000100:00100000:2.0:1789302142.048881:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121420928:0@lo:400: 00010000:00080000:2.0:1789302142.048908:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd801880 x1876219121421440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302142.048919:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121421440:0@lo:400: 00010000:00080000:2.0:1789302142.048932:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd803800 x1876219121421952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302142.048940:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789302142.048954:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121421952:0@lo:400: 00000100:00100000:2.0:1789302142.048965:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121421056:0@lo:400: 00010000:00080000:2.0:1789302142.048975:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd801180 x1876219121421568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302142.048983:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121421568:0@lo:400: 00010000:00080000:2.0:1789302142.049002:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd800380 x1876219121422080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302142.049012:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121422080:0@lo:400: 00000100:00100000:2.0:1789302142.049023:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121420544:0@lo:400: 00000100:00100000:1.0:1789302142.053883:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121421696:12345-0@lo:400: Request processed in 15111us (15291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302142.053898:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789302142.053918:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121421696:0@lo:400: 00000100:00100000:3.0:1789302142.053957:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121421312:12345-0@lo:400: Request processed in 15170us (15304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302142.053967:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789302142.054010:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd803480 x1876219121421312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302142.054024:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121421312:0@lo:400: 00000100:00100000:1.0:1789302142.278644:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302142.278786:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101449728 00000100:00100000:0.0:1789302142.278796:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101449728 00000100:00080000:2.0:1789302142.279960:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302142.281075:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00100000:0.0:1789302142.281094:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:6248:x1876219101449728:12345-192.168.203.9@tcp:41: 00000004:00000024:0.0:1789302142.281150:0:9541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789302142.281246:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:6248:x1876219101449728:12345-192.168.203.9@tcp:41: Request processed in 160us (2610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302142.281254:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00100000:3.0:1789302142.286529:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302142.286693:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101449856 00000100:00100000:0.0:1789302142.286705:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101449856 00000100:00080000:2.0:1789302142.286845:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789302142.287502:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00100000:0.0:1789302142.287517:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+6:6248:x1876219101449856:12345-192.168.203.9@tcp:41: 00000004:00000024:0.0:1789302142.287558:0:10111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789302142.287625:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+6:6248:x1876219101449856:12345-192.168.203.9@tcp:41: Request processed in 113us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302142.287651:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00100000:3.0:1789302142.291482:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302142.291581:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101449984 00000100:00100000:1.0:1789302142.291590:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101449984 00000100:00100000:1.0:1789302142.291667:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00100000:1.0:1789302142.291677:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c76ee310-c3b4-4286-aaea-77936c269d98+6:6248:x1876219101449984:12345-192.168.203.9@tcp:13: 00002000:00000024:1.0:1789302142.291706:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302142.291758:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c76ee310-c3b4-4286-aaea-77936c269d98+6:6248:x1876219101449984:12345-192.168.203.9@tcp:13: Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302142.291765:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00080000:2.0:1789302142.291890:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302142.293956:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302142.294385:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101450112 00000100:00100000:1.0:1789302142.294396:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101450112 00000100:00100000:1.0:1789302142.295564:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:1.0:1789302142.295578:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c76ee310-c3b4-4286-aaea-77936c269d98+6:6248:x1876219101450112:12345-192.168.203.9@tcp:13: 00002000:00000024:1.0:1789302142.295626:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302142.295707:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c76ee310-c3b4-4286-aaea-77936c269d98+6:6248:x1876219101450112:12345-192.168.203.9@tcp:13: Request processed in 132us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302142.295715:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00080000:2.0:1789302142.301090:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789302142.359903:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302142.548447:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302142.548472:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121422208:0@lo:13: 00000100:00100000:3.0:1789302142.548531:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302142.548718:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302142.548728:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121422336:0@lo:13: 00000100:00100000:0.0:1789302142.548754:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302142.548888:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121422208 00000100:00100000:1.0:1789302142.548897:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121422208 00000100:00100000:1.0:1789302142.548930:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121422336 00000100:00100000:1.0:1789302142.548933:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121422336 00000100:00100000:1.0:1789302142.548948:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789302142.548957:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121422208:12345-0@lo:13: 00002000:00000024:1.0:1789302142.548979:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302142.549031:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121422208:12345-0@lo:13: Request processed in 75us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302142.549038:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789302142.549055:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789302142.549061:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876219121422336:12345-0@lo:13: 00002000:00000024:1.0:1789302142.549070:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302142.549104:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876219121422336:12345-0@lo:13: Request processed in 44us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302142.549132:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789302142.549324:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bdbb4000 x1876219121422336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302142.549355:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121422336:0@lo:13: 00010000:00080000:3.0:1789302142.549483:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a16d80 x1876219121422208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302142.549497:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121422208:0@lo:13: 00000100:00100000:1.0:1789302143.063370:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121422464:0@lo:41: 00000100:00100000:1.0:1789302143.063452:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302143.063526:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121422464 00000100:00100000:1.0:1789302143.063533:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121422464 00000100:00100000:1.0:1789302143.063587:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789302143.063596:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121422464:12345-0@lo:41: 00000004:00000024:1.0:1789302143.063630:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789302143.063696:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121422464:12345-0@lo:41: Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302143.063704:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789302143.063754:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121422464:0@lo:41: 00000001:00100000:3.0:1789302143.080045:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000001:00080000:3.0:1789302143.080062:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:2.0:1789302143.383501:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302144.405404:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302144.853545:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302144.853625:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302144.853679:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101450368 00000100:00100000:3.0:1789302144.853685:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302144.853701:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101450368 00000100:00100000:3.0:1789302144.853724:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302144.853774:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302144.853793:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101450496 00000100:00100000:2.0:1789302144.853798:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101450496 00000100:00100000:3.0:1789302144.853813:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 55 00000100:00100000:1.0:1789302144.853964:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101450240 00000100:00100000:1.0:1789302144.853970:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101450240 00000100:00100000:1.0:1789302144.854011:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 198 00000100:00100000:1.0:1789302144.854023:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2399:x1876219101450240:12345-192.168.203.9@tcp:400: 00000100:00100000:1.0:1789302144.854145:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2399:x1876219101450240:12345-192.168.203.9@tcp:400: Request processed in 124us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302144.854152:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 198 00000100:00100000:1.0:1789302144.854201:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101450624 00000100:00100000:3.0:1789302144.854265:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101450368:12345-192.168.203.9@tcp:400: 00000100:00100000:3.0:1789302144.854303:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101450368:12345-192.168.203.9@tcp:400: Request processed in 41us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302144.854324:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101450624 00000100:00100000:1.0:1789302144.854358:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101450752 00000100:00100000:1.0:1789302144.854362:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101450752 00000100:00100000:1.0:1789302144.854385:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:1.0:1789302144.854392:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101450624:12345-192.168.203.9@tcp:400: 00000100:00100000:1.0:1789302144.854423:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101450624:12345-192.168.203.9@tcp:400: Request processed in 31us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302144.854429:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:1.0:1789302144.854442:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:1.0:1789302144.854448:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101450752:12345-192.168.203.9@tcp:400: 00000100:00100000:1.0:1789302144.854471:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101450752:12345-192.168.203.9@tcp:400: Request processed in 23us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302144.854477:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:2.0:1789302144.856943:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 56 00000100:00100000:2.0:1789302144.856984:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101450496:12345-192.168.203.9@tcp:400: 00000100:00100000:2.0:1789302144.857146:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101450496:12345-192.168.203.9@tcp:400: Request processed in 186us (3422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302144.857154:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 56 00000100:00100000:3.0:1789302144.864563:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 55 00000100:00080000:2.0:1789302144.864866:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302144.864876:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302144.864881:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302144.864885:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1789302145.122427:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000001:00100000:3.0:1789302145.125183:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000001:02000400:2.0:1789302145.227965:0:10197:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789302145.433617:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302145.620783:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302145.620819:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121422720:0@lo:13: 00000100:00100000:2.0:1789302145.620933:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302145.621041:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121422720 00000100:00100000:2.0:1789302145.621053:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121422720 00000100:00100000:2.0:1789302145.621368:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789302145.621384:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121422720:12345-0@lo:13: 00002000:00000024:2.0:1789302145.621421:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302145.621478:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121422720:12345-0@lo:13: Request processed in 101us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302145.621508:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789302145.621662:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302145.621704:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a17800 x1876219121422720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302145.621726:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121422720:0@lo:13: 00000100:00100000:3.0:1789302145.622002:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121422592:0@lo:13: 00000100:00100000:3.0:1789302145.622047:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302145.622202:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121422592 00000100:00100000:2.0:1789302145.622208:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121422592 00000100:00100000:2.0:1789302145.622420:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789302145.622430:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121422592:12345-0@lo:13: 00002000:00000024:2.0:1789302145.622447:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302145.622490:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121422592:12345-0@lo:13: Request processed in 62us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302145.622496:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789302145.622538:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bdbb5f80 x1876219121422592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302145.622555:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121422592:0@lo:13: 00000100:00080000:3.0:1789302145.622845:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1789302146.140776:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00010000:00010000:3.0:1789302146.462961:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302147.156297:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121422848:0@lo:41: 00000100:00100000:2.0:1789302147.156369:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.157038:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121422976:0@lo:400: 00000100:00100000:3.0:1789302147.157080:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.157148:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121423488:0@lo:400: 00000100:00100000:3.0:1789302147.157186:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.157206:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121424000:0@lo:400: 00000100:00100000:2.0:1789302147.157227:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121423360:0@lo:400: 00000100:00100000:3.0:1789302147.157231:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.157249:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789302147.157251:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.157254:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121423104:0@lo:400: 00000100:00100000:2.0:1789302147.157267:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121423872:0@lo:400: 00000100:00100000:3.0:1789302147.157271:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.157286:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121423616:0@lo:400: 00000100:00100000:2.0:1789302147.157287:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.157303:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302147.157303:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121424384:0@lo:400: 00000100:00100000:3.0:1789302147.157318:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121424128:0@lo:400: 00000100:00100000:2.0:1789302147.157320:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302147.157346:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789302147.157348:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302147.157352:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121423232:0@lo:400: 00000100:00100000:3.0:1789302147.157371:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121422976 00000100:00100000:2.0:1789302147.157372:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.157383:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121422976 00000100:00100000:2.0:1789302147.157387:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121423744:0@lo:400: 00000100:00100000:2.0:1789302147.157420:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.157425:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789302147.157433:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121422976:12345-0@lo:400: 00000100:00100000:2.0:1789302147.157435:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121424256:0@lo:400: 00000100:00100000:2.0:1789302147.157452:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.157475:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121422976:12345-0@lo:400: Request processed in 42us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302147.157479:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121422848 00000100:00100000:3.0:1789302147.157482:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789302147.157482:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121422848 00000100:00100000:2.0:1789302147.157509:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121423232 00000100:00100000:2.0:1789302147.157512:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121423232 00000100:00100000:3.0:1789302147.157514:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121423488 00000100:00100000:3.0:1789302147.157516:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121423488 00000100:00100000:2.0:1789302147.157524:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789302147.157530:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121422848:12345-0@lo:41: 00000100:00100000:3.0:1789302147.157541:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121424000 00000100:00100000:3.0:1789302147.157543:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121424000 00000100:00100000:3.0:1789302147.157554:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121423360 00000100:00100000:3.0:1789302147.157556:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121423360 00000004:00000024:2.0:1789302147.157557:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302147.157578:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121423104 00000100:00100000:3.0:1789302147.157581:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121423104 00000100:00100000:2.0:1789302147.157591:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121422848:12345-0@lo:41: Request processed in 62us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302147.157592:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121423616 00000100:00100000:3.0:1789302147.157594:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121423616 00000100:00100000:2.0:1789302147.157598:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789302147.157604:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121424128 00000100:00100000:3.0:1789302147.157606:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121424128 00000100:00100000:3.0:1789302147.157617:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789302147.157617:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789302147.157623:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121423488:12345-0@lo:400: 00000100:00100000:2.0:1789302147.157623:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121423232:12345-0@lo:400: 00000100:00100000:3.0:1789302147.157648:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121423488:12345-0@lo:400: Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302147.157648:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121423232:12345-0@lo:400: Request processed in 25us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302147.157655:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789302147.157655:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789302147.157666:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789302147.157672:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121424000:12345-0@lo:400: 00000100:00100000:2.0:1789302147.157680:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789302147.157686:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121423360:12345-0@lo:400: 00000100:00100000:3.0:1789302147.157695:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121424000:12345-0@lo:400: Request processed in 24us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302147.157700:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789302147.157708:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121423360:12345-0@lo:400: Request processed in 23us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302147.157710:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789302147.157717:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789302147.157720:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121423104:12345-0@lo:400: 00000100:00100000:2.0:1789302147.157732:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789302147.157738:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121423616:12345-0@lo:400: 00000100:00100000:3.0:1789302147.157742:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121423104:12345-0@lo:400: Request processed in 23us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302147.157747:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789302147.157759:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789302147.157760:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121423616:12345-0@lo:400: Request processed in 23us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302147.157764:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121424128:12345-0@lo:400: 00000100:00100000:2.0:1789302147.157766:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789302147.157785:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121423872 00000100:00100000:3.0:1789302147.157786:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121424128:12345-0@lo:400: Request processed in 22us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302147.157787:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121423872 00000100:00100000:3.0:1789302147.157791:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789302147.157804:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121424384 00000100:00100000:2.0:1789302147.157806:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121424384 00000100:00080000:3.0:1789302147.157815:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302147.157817:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121423744 00000100:00080000:3.0:1789302147.157819:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302147.157819:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121423744 00000100:00080000:3.0:1789302147.157821:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789302147.157823:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789302147.157825:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302147.157829:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121424256 00000100:00100000:3.0:1789302147.157851:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121423104:0@lo:400: 00010000:00080000:3.0:1789302147.157863:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd803800 x1876219121423616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302147.157872:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121423616:0@lo:400: 00010000:00080000:3.0:1789302147.157881:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383440380 x1876219121424128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302147.157889:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121424128:0@lo:400: 00000100:00100000:3.0:1789302147.157897:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121422976:0@lo:400: 00000100:00100000:3.0:1789302147.157904:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121423488:0@lo:400: 00000100:00100000:3.0:1789302147.157910:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121424000:0@lo:400: 00000100:00100000:2.0:1789302147.160968:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121424256 00000100:00100000:2.0:1789302147.161054:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789302147.161067:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121423872:12345-0@lo:400: 00000100:00100000:2.0:1789302147.164383:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121423872:12345-0@lo:400: Request processed in 3315us (7089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302147.164394:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789302147.164431:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789302147.164445:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121424384:12345-0@lo:400: 00000100:00100000:2.0:1789302147.164474:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121424384:12345-0@lo:400: Request processed in 36us (7152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302147.164479:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789302147.164498:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302147.164504:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121423744:12345-0@lo:400: 00000100:00100000:2.0:1789302147.164553:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121423744:12345-0@lo:400: Request processed in 49us (7132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302147.164559:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302147.164578:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789302147.164585:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121424256:12345-0@lo:400: 00000100:00100000:2.0:1789302147.164614:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121424256:12345-0@lo:400: Request processed in 30us (7160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302147.164619:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789302147.164663:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302147.164699:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121423232:0@lo:400: 00010000:00080000:2.0:1789302147.164714:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd801880 x1876219121423744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302147.164726:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121423744:0@lo:400: 00010000:00080000:2.0:1789302147.164737:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383440700 x1876219121424256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302147.164746:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121424256:0@lo:400: 00000100:00100000:2.0:1789302147.164758:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121423360:0@lo:400: 00010000:00080000:2.0:1789302147.164768:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd801f80 x1876219121423872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302147.164776:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121423872:0@lo:400: 00010000:00080000:2.0:1789302147.164786:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383441c00 x1876219121424384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302147.164794:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1789302147.164809:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121424384:0@lo:400: 00000100:00100000:2.0:1789302147.164827:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121422848:0@lo:41: 00010000:00010000:2.0:1789302147.477221:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302147.668338:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121424512:0@lo:13: 00000100:00100000:3.0:1789302147.668655:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.668713:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302147.668720:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121424640:0@lo:13: 00000100:00100000:3.0:1789302147.668743:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302147.668791:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121424512 00000100:00100000:3.0:1789302147.668799:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121424512 00000100:00100000:3.0:1789302147.668834:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121424640 00000100:00100000:3.0:1789302147.668837:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121424640 00000100:00100000:3.0:1789302147.669072:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789302147.669081:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121424512:12345-0@lo:13: 00002000:00000024:3.0:1789302147.669135:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302147.669195:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121424512:12345-0@lo:13: Request processed in 115us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302147.669201:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789302147.669217:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789302147.669224:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121424640:12345-0@lo:13: 00002000:00000024:3.0:1789302147.669233:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302147.669256:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121424640:12345-0@lo:13: Request processed in 33us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302147.669261:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789302147.669335:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f0bb80 x1876219121424640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302147.669353:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121424640:0@lo:13: 00010000:00080000:0.0:1789302147.669373:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f0aa00 x1876219121424512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302147.669384:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121424512:0@lo:13: 00000100:00100000:0.0:1789302148.185758:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302148.185785:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121424768:0@lo:41: 00000100:00100000:0.0:1789302148.185864:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302148.186034:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121424768 00000100:00100000:1.0:1789302148.186043:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121424768 00000100:00100000:1.0:1789302148.186098:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789302148.186108:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121424768:12345-0@lo:41: 00000004:00000024:1.0:1789302148.186177:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789302148.186232:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121424768:12345-0@lo:41: Request processed in 125us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302148.186240:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789302148.186480:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121424768:0@lo:41: 00010000:00010000:2.0:1789302148.500318:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789302148.591650:0:10344:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0b57e870 20000000:00000080:2.0:1789302148.591667:0:10344:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cc383446400 uarg=0000000000000000 20000000:01000000:2.0:1789302148.591708:0:10344:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789302148.591711:0:10344:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789302148.591714:0:10344:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789302148.591719:0:10344:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789302148.591724:0:10344:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789302148.591788:0:10344:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789302148.591791:0:10344:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789302148.592451:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1789302148.592580:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1789302148.592609:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1789302148.592624:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1789302148.592634:0:10344:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789302148.592636:0:10344:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789302148.592956:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1789302148.593081:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1789302148.593101:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1789302148.593170:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1789302148.593183:0:10344:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789302148.593185:0:10344:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789302148.593655:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1789302148.593931:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1789302148.593956:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1789302148.593971:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1789302148.593979:0:10344:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789302148.593981:0:10344:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789302148.595344:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1789302148.595565:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1789302148.595592:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1789302148.595606:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1789302148.595616:0:10344:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789302148.595618:0:10344:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789302148.595916:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1789302148.596047:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1789302148.596065:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1789302148.596077:0:10344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:2.0:1789302148.596090:0:10344:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789302148.596216:0:10344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596244:0:10344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd399187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399180 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596253:0:10344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd3991b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3991aa expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596260:0:10344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd3991f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3991e9 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596267:0:10344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b538f200/0x1ff82925bd3991fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3991f7 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596274:0:10344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4c2178400/0x1ff82925bd39920c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399205 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596280:0:10344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa983a00/0x1ff82925bd399228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399221 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596286:0:10344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4c2178600/0x1ff82925bd399252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39924b expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596293:0:10344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39926e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399267 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596300:0:10344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399291 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596309:0:10344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4addd2200/0x1ff82925bd3992a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d0 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596329:0:10344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4addd3e00/0x1ff82925bd3992ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d7 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596336:0:10344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596375:0:10344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4addd3e00/0x1ff82925bd3992ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d7 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596389:0:10344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc4addd3e00/0x1ff82925bd3992ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d7 expref: 9 pid: 6525 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.596403:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121424896:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302148.596536:0:10344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4addd2200/0x1ff82925bd3992a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d0 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596545:0:10344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc4addd2200/0x1ff82925bd3992a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d0 expref: 9 pid: 6525 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.596553:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425024:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302148.596579:0:10344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399291 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596586:0:10344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399291 expref: 23 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.596594:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425152:0@lo:104: 00000100:00100000:2.0:1789302148.596627:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302148.596672:0:10344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39926e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399267 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596680:0:10344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39926e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399267 expref: 23 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.596687:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383804000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425280:0@lo:104: 00000100:00100000:2.0:1789302148.596704:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302148.596725:0:10344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4c2178600/0x1ff82925bd399252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39924b expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596733:0:10344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4c2178600/0x1ff82925bd399252 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39924b expref: 23 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.596741:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425408:0@lo:104: 00000100:00100000:2.0:1789302148.596770:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302148.596785:0:10344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa983a00/0x1ff82925bd399228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399221 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596793:0:10344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4aa983a00/0x1ff82925bd399228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399221 expref: 23 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.596800:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425536:0@lo:104: 00000100:00100000:2.0:1789302148.596819:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302148.596832:0:10344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4c2178400/0x1ff82925bd39920c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399205 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596839:0:10344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4c2178400/0x1ff82925bd39920c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399205 expref: 23 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.596846:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425664:0@lo:104: 00010000:00010000:2.0:1789302148.596873:0:10344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b538f200/0x1ff82925bd3991fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd3991f7 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596881:0:10344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4b538f200/0x1ff82925bd3991fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd3991f7 expref: 23 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.596888:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425792:0@lo:104: 00010000:00010000:2.0:1789302148.596909:0:10344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd3991f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd3991e9 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596916:0:10344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd3991f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd3991e9 expref: 23 pid: 6524 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.596924:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425920:0@lo:104: 00010000:00010000:2.0:1789302148.596945:0:10344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd3991b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd3991aa expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596953:0:10344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd3991b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd3991aa expref: 23 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.596960:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121426048:0@lo:104: 00010000:00010000:2.0:1789302148.596982:0:10344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd399187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399180 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.596989:0:10344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd399187 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399180 expref: 23 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.596996:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121426176:0@lo:104: 00000100:00100000:2.0:1789302148.597012:0:10344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33540 going to sleep for 11 seconds 00000100:00100000:2.0:1789302148.597048:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789302148.597064:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.597084:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.597094:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.597101:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.597108:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.597142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121425152 00000100:00100000:2.0:1789302148.597149:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121425152 00000100:00100000:2.0:1789302148.597190:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121425280 00000100:00100000:2.0:1789302148.597194:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121425280 00000100:00100000:2.0:1789302148.597204:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121425408 00000100:00100000:2.0:1789302148.597207:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121425408 00000100:00100000:2.0:1789302148.597216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121425536 00000100:00100000:2.0:1789302148.597218:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121425536 00000100:00100000:2.0:1789302148.597239:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121425664 00000100:00100000:2.0:1789302148.597242:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121425664 00000100:00100000:2.0:1789302148.597252:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121425792 00000100:00100000:2.0:1789302148.597254:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121425792 00000100:00100000:2.0:1789302148.597262:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121425920 00000100:00100000:2.0:1789302148.597265:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121425920 00000100:00100000:2.0:1789302148.597273:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121426048 00000100:00100000:2.0:1789302148.597275:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121426048 00000100:00100000:2.0:1789302148.597283:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121426176 00000100:00100000:2.0:1789302148.597285:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121426176 00000100:00100000:2.0:1789302148.597298:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789302148.597305:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+11:10344:x1876219121425152:12345-0@lo:104: 00010000:00010000:2.0:1789302148.597317:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597362:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789302148.597367:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+11:10344:x1876219121425152:12345-0@lo:104: Request processed in 63us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.597374:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789302148.597394:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789302148.597399:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+10:10344:x1876219121425280:12345-0@lo:104: 00010000:00010000:2.0:1789302148.597407:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597437:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789302148.597441:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+10:10344:x1876219121425280:12345-0@lo:104: Request processed in 43us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.597447:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789302148.597458:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789302148.597463:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+9:10344:x1876219121425408:12345-0@lo:104: 00010000:00010000:2.0:1789302148.597469:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597496:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789302148.597502:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+9:10344:x1876219121425408:12345-0@lo:104: Request processed in 39us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.597507:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789302148.597517:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789302148.597522:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4add51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+8:10344:x1876219121425536:12345-0@lo:104: 00010000:00010000:2.0:1789302148.597528:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597548:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789302148.597552:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4add51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+8:10344:x1876219121425536:12345-0@lo:104: Request processed in 31us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.597556:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789302148.597588:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789302148.597594:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+7:10344:x1876219121425664:12345-0@lo:104: 00010000:00010000:2.0:1789302148.597601:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597624:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789302148.597628:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+7:10344:x1876219121425664:12345-0@lo:104: Request processed in 36us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.597633:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789302148.597645:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789302148.597651:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+6:10344:x1876219121425792:12345-0@lo:104: 00010000:00010000:2.0:1789302148.597657:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597680:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789302148.597684:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+6:10344:x1876219121425792:12345-0@lo:104: Request processed in 34us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.597688:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789302148.597699:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789302148.597704:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:10344:x1876219121425920:12345-0@lo:104: 00010000:00010000:2.0:1789302148.597711:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597733:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789302148.597738:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:10344:x1876219121425920:12345-0@lo:104: Request processed in 35us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.597743:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789302148.597761:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789302148.597766:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:10344:x1876219121426048:12345-0@lo:104: 00010000:00010000:2.0:1789302148.597773:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597797:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1789302148.597802:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:10344:x1876219121426048:12345-0@lo:104: Request processed in 37us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.597807:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789302148.597817:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302148.597823:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:10344:x1876219121426176:12345-0@lo:104: 00010000:00010000:2.0:1789302148.597829:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597850:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1789302148.597855:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:10344:x1876219121426176:12345-0@lo:104: Request processed in 33us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.597859:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789302148.597875:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1789302148.597879:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597886:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178c00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302148.597890:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597898:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302148.597916:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302148.597922:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302148.597949:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597955:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302148.597974:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597981:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178c00/0x1ff82925bd399291 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399298 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.597997:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1789302148.598000:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598005:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983e00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302148.598008:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598014:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302148.598020:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302148.598026:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302148.598044:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598050:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302148.598063:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598069:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983e00/0x1ff82925bd399267 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39926e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598078:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789302148.598081:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598086:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178800 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302148.598089:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598096:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302148.598102:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302148.598107:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302148.598138:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598144:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302148.598149:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598176:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4c2178800/0x1ff82925bd39924b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399252 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598186:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789302148.598189:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598195:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f000 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302148.598198:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598205:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302148.598210:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302148.598216:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302148.598230:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598236:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302148.598241:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598248:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f000/0x1ff82925bd399221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399228 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598256:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789302148.598265:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598271:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538ee00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302148.598274:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598281:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302148.598288:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302148.598293:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302148.598305:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598310:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302148.598314:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598320:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538ee00/0x1ff82925bd399205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39920c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598328:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789302148.598331:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598335:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538e600 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302148.598338:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598353:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302148.598360:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302148.598365:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302148.598375:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598380:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302148.598384:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598390:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd3991f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991fe expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598397:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789302148.598400:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598405:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538fe00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302148.598408:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598414:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302148.598420:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302148.598430:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302148.598442:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598447:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302148.598451:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598458:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fe00/0x1ff82925bd3991e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991f0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598466:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302148.598469:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598474:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983800 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302148.598477:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598483:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302148.598489:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302148.598494:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302148.598502:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598507:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302148.598516:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598522:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd3991aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991b1 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598528:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302148.598531:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598536:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166fa00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302148.598538:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598544:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302148.598549:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302148.598553:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302148.598561:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598565:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302148.598568:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598573:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48166fa00/0x1ff82925bd399180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399187 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.598586:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302148.598592:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302148.598594:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302148.598602:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302148.598615:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121426688:0@lo:103: 00000100:00100000:2.0:1789302148.598650:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.598669:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121427200:0@lo:103: 00000100:00100000:2.0:1789302148.598685:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.598702:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789302148.598708:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121426304:0@lo:103: 00000100:00100000:2.0:1789302148.598725:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.598740:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121426816:0@lo:103: 00000100:00100000:2.0:1789302148.598756:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.598766:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121427328:0@lo:103: 00000100:00100000:2.0:1789302148.598781:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.598799:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121426560:0@lo:103: 00000100:00100000:2.0:1789302148.598818:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.598827:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121427072:0@lo:103: 00000100:00100000:2.0:1789302148.598843:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.598852:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789302148.598856:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121426432:0@lo:103: 00000100:00100000:2.0:1789302148.598871:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.598880:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121426944:0@lo:103: 00000100:00100000:2.0:1789302148.598911:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302148.598933:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121426688 00000100:00100000:2.0:1789302148.598939:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121426688 00010000:00010000:2.0:1789302148.598960:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa983a00/0x1ff82925bd399228 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399221 expref: 24 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.598985:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121427200 00000100:00100000:2.0:1789302148.598988:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121427200 00010000:00010000:2.0:1789302148.599009:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd3991b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3991aa expref: 25 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.599021:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121426304 00000100:00100000:2.0:1789302148.599024:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121426304 00010000:00010000:2.0:1789302148.599033:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399298 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399291 expref: 26 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.599043:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121426816 00000100:00100000:2.0:1789302148.599045:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121426816 00010000:00010000:2.0:1789302148.599054:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4c2178400/0x1ff82925bd39920c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399205 expref: 27 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.599063:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121427328 00000100:00100000:2.0:1789302148.599065:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121427328 00010000:00010000:2.0:1789302148.599073:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd399187 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399180 expref: 28 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.599081:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121426560 00000100:00100000:2.0:1789302148.599084:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121426560 00010000:00010000:2.0:1789302148.599092:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4c2178600/0x1ff82925bd399252 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39924b expref: 29 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.599101:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121427072 00000100:00100000:2.0:1789302148.599103:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121427072 00010000:00010000:2.0:1789302148.599133:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd3991f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3991e9 expref: 30 pid: 6524 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.599144:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121426432 00000100:00100000:1.0:1789302148.599217:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121426944 00000100:00100000:1.0:1789302148.599221:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121426944 00010000:00010000:1.0:1789302148.599236:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b538f200/0x1ff82925bd3991fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3991f7 expref: 31 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302148.599252:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789302148.599259:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc49a4ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+31:3645:x1876219121426688:12345-0@lo:103: 00010000:00010000:1.0:1789302148.599270:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302148.599274:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa983a00/0x1ff82925bd399228 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399221 expref: 31 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599283:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa983a00/0x1ff82925bd399228 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399221 expref: 31 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599298:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302148.599332:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc49a4ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+31:3645:x1876219121426688:12345-0@lo:103: Request processed in 73us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302148.599339:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789302148.599377:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789302148.599384:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+30:3645:x1876219121427200:12345-0@lo:103: 00010000:00010000:1.0:1789302148.599397:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302148.599401:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd3991b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3991aa expref: 30 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599409:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd3991b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd3991aa expref: 30 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599417:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302148.599438:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+30:3645:x1876219121427200:12345-0@lo:103: Request processed in 55us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302148.599444:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789302148.599457:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789302148.599463:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+29:3645:x1876219121426304:12345-0@lo:103: 00010000:00010000:1.0:1789302148.599470:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302148.599474:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399298 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399291 expref: 29 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599483:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399291 expref: 29 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599491:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302148.599512:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+29:3645:x1876219121426304:12345-0@lo:103: Request processed in 49us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302148.599517:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789302148.599529:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789302148.599535:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+28:3645:x1876219121426816:12345-0@lo:103: 00010000:00010000:1.0:1789302148.599541:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302148.599545:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4c2178400/0x1ff82925bd39920c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399205 expref: 28 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599558:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4c2178400/0x1ff82925bd39920c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399205 expref: 28 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599567:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302148.599587:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+28:3645:x1876219121426816:12345-0@lo:103: Request processed in 53us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302148.599593:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789302148.599605:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789302148.599610:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+27:3645:x1876219121427328:12345-0@lo:103: 00010000:00010000:1.0:1789302148.599616:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302148.599620:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd399187 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399180 expref: 27 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599627:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd399187 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399180 expref: 27 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599635:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302148.599653:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+27:3645:x1876219121427328:12345-0@lo:103: Request processed in 43us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302148.599659:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789302148.599670:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789302148.599675:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+26:3648:x1876219121426560:12345-0@lo:103: 00010000:00010000:1.0:1789302148.599681:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302148.599684:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4c2178600/0x1ff82925bd399252 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39924b expref: 26 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599691:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4c2178600/0x1ff82925bd399252 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39924b expref: 26 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599705:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302148.599729:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+26:3648:x1876219121426560:12345-0@lo:103: Request processed in 54us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302148.599735:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789302148.599747:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789302148.599751:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+25:3648:x1876219121427072:12345-0@lo:103: 00010000:00010000:1.0:1789302148.599758:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302148.599762:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd3991f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3991e9 expref: 25 pid: 6524 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599769:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd3991f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd3991e9 expref: 25 pid: 6524 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599776:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302148.599795:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+25:3648:x1876219121427072:12345-0@lo:103: Request processed in 43us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302148.599800:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789302148.599812:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789302148.599818:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121426944:12345-0@lo:103: 00010000:00010000:1.0:1789302148.599824:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302148.599829:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b538f200/0x1ff82925bd3991fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3991f7 expref: 24 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599836:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b538f200/0x1ff82925bd3991fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd3991f7 expref: 24 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302148.599844:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302148.599869:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121426944:12345-0@lo:103: Request processed in 51us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302148.599875:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789302148.599914:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121426944:0@lo:103: 00000100:00100000:1.0:1789302148.599923:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121426560:0@lo:103: 00000100:00100000:1.0:1789302148.599930:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121427072:0@lo:103: 00000100:00100000:1.0:1789302148.599959:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121426304:0@lo:103: 00000100:00100000:1.0:1789302148.599966:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121426816:0@lo:103: 00000100:00100000:1.0:1789302148.599972:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121427328:0@lo:103: 00000100:00100000:1.0:1789302148.599977:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121426688:0@lo:103: 00000100:00100000:1.0:1789302148.599983:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121427200:0@lo:103: 00010000:00010000:3.0:1789302148.600082:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302148.600186:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399298 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399291 expref: 23 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302148.600198:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425152:0@lo:104: 00000100:00100000:3.0:1789302148.600208:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383804000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425280:0@lo:104: 00010000:00010000:3.0:1789302148.600215:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2178600/0x1ff82925bd399252 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39924b expref: 22 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302148.600223:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425408:0@lo:104: 00010000:00010000:3.0:1789302148.600231:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa983a00/0x1ff82925bd399228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399221 expref: 21 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302148.600239:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425536:0@lo:104: 00010000:00010000:3.0:1789302148.600248:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2178400/0x1ff82925bd39920c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399205 expref: 20 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302148.600255:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425664:0@lo:104: 00010000:00010000:3.0:1789302148.600264:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538f200/0x1ff82925bd3991fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd3991f7 expref: 19 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302148.600272:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425792:0@lo:104: 00010000:00010000:3.0:1789302148.600281:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd3991f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd3991e9 expref: 18 pid: 6524 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302148.600289:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425920:0@lo:104: 00010000:00010000:3.0:1789302148.600298:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2178200/0x1ff82925bd3991b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd3991aa expref: 17 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302148.600305:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121426048:0@lo:104: 00010000:00010000:3.0:1789302148.600323:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd399187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399180 expref: 16 pid: 6523 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302148.600331:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121426176:0@lo:104: 00000100:00100000:2.0:1789302148.600968:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121426432 00010000:00010000:2.0:1789302148.600996:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39926e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399267 expref: 16 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.601070:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302148.601078:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc49a4ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+16:3648:x1876219121426432:12345-0@lo:103: 00010000:00010000:2.0:1789302148.601087:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302148.601092:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39926e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399267 expref: 16 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.601101:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39926e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399267 expref: 16 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.601305:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39926e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399267 expref: 16 pid: 6525 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.601319:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302148.601380:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc49a4ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+15:3648:x1876219121426432:12345-0@lo:103: Request processed in 303us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.601387:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302148.601465:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121426432:0@lo:103: 00000100:00100000:1.0:1789302148.603348:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302148.603430:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121424896:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302148.603441:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10344:1876219121425024:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302148.603484:0:10344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.604265:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101450880 00000100:00100000:2.0:1789302148.604273:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101450880 00010000:00010000:2.0:1789302148.604308:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4addd3e00/0x1ff82925bd3992ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d7 expref: 10 pid: 6525 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.604343:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 33 00000100:00100000:2.0:1789302148.604352:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2399:x1876219101450880:12345-192.168.203.9@tcp:103: 00010000:00010000:2.0:1789302148.604366:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302148.604372:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4addd3e00/0x1ff82925bd3992ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d7 expref: 10 pid: 6525 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.604400:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4addd3e00/0x1ff82925bd3992ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d7 expref: 10 pid: 6525 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.604415:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4addd3e00/0x1ff82925bd3992ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d7 expref: 10 pid: 6525 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.604428:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302148.604572:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:2399:x1876219101450880:12345-192.168.203.9@tcp:103: Request processed in 219us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.604580:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 33 00000100:00100000:0.0:1789302148.617448:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302148.617517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101451008 00000100:00100000:2.0:1789302148.617526:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101451008 00010000:00010000:2.0:1789302148.617568:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4addd2200/0x1ff82925bd3992a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d0 expref: 9 pid: 6525 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302148.617611:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 34 00000100:00100000:2.0:1789302148.617621:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:2398:x1876219101451008:12345-192.168.203.9@tcp:103: 00010000:00010000:2.0:1789302148.617637:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302148.617644:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4addd2200/0x1ff82925bd3992a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d0 expref: 9 pid: 6525 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617656:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4addd2200/0x1ff82925bd3992a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d0 expref: 9 pid: 6525 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617673:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4addd2200/0x1ff82925bd3992a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a58d0 expref: 9 pid: 6525 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617689:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617709:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617726:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617734:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617740:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617748:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617754:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302148.617758:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617766:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617778:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302148.617788:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302148.617852:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:2398:x1876219101451008:12345-192.168.203.9@tcp:103: Request processed in 232us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302148.617860:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 34 00010000:00010000:3.0:1789302148.617966:0:10344:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302148.617975:0:10344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302148.617981:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5349200/0x1ff82925bd3992ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302149.526275:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302149.978244:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302149.979099:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101451136 00000100:00100000:1.0:1789302149.979182:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101451136 00000100:00100000:1.0:1789302149.979250:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 200 00000100:00100000:1.0:1789302149.979261:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:2397:x1876219101451136:12345-192.168.203.9@tcp:400: 00000100:00100000:1.0:1789302149.980564:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:2397:x1876219101451136:12345-192.168.203.9@tcp:400: Request processed in 1298us (2323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302149.980574:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 200 00000100:00100000:2.0:1789302149.982539:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302149.982675:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302149.982706:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302149.982758:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101451392 00000100:00100000:3.0:1789302149.982767:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101451392 00000100:00100000:3.0:1789302149.982827:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101451264 00000100:00100000:3.0:1789302149.982830:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101451264 00000100:00080000:0.0:1789302149.982851:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302149.982856:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00080000:0.0:1789302149.982857:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302149.982867:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101451392:12345-192.168.203.9@tcp:400: 00000100:00100000:0.0:1789302149.982876:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 64 00000100:00100000:0.0:1789302149.982898:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2397:x1876219101451264:12345-192.168.203.9@tcp:400: 00000100:00100000:3.0:1789302149.982934:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101451392:12345-192.168.203.9@tcp:400: Request processed in 68us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302149.982936:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2397:x1876219101451264:12345-192.168.203.9@tcp:400: Request processed in 40us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302149.982947:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:1.0:1789302149.983001:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101451648 00000100:00100000:1.0:1789302149.983006:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101451648 00000100:00100000:2.0:1789302149.983040:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302149.983215:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 64 00000100:00100000:1.0:1789302149.983218:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101451520 00000100:00100000:1.0:1789302149.983224:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101451520 00000100:00080000:0.0:1789302149.983236:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302149.983241:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302149.983258:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:1.0:1789302149.983274:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101451648:12345-192.168.203.9@tcp:400: 00000100:00100000:1.0:1789302149.983317:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101451648:12345-192.168.203.9@tcp:400: Request processed in 45us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302149.983908:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00100000:1.0:1789302149.983917:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:0.0:1789302149.983922:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101451520:12345-192.168.203.9@tcp:400: 00000100:00100000:0.0:1789302149.983957:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101451520:12345-192.168.203.9@tcp:400: Request processed in 41us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302149.983964:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 19 10000000:01000000:2.0:1789302150.228581:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789302150.228590:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc382b0f800 from 48 10000000:01000000:2.0:1789302150.228595:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789302150.228644:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.228656:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.228667:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302150.228692:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121427456:0@lo:101: 00000100:00100000:2.0:1789302150.228768:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302150.228825:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852cd540 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.228869:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121427456 00000100:00100000:2.0:1789302150.228877:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121427456 00000100:00100000:2.0:1789302150.228930:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789302150.228942:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+15:6527:x1876219121427456:12345-0@lo:101: 00010000:00010000:2.0:1789302150.228955:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302150.228969:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd3992fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3992f3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.228999:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd3992fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3992f3 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.229011:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd3992fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3992f3 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.229034:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349400, rc 0) 00000100:00100000:2.0:1789302150.229084:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121427456:12345-0@lo:101: Request processed in 144us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.229093:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789302150.229491:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121427456:0@lo:101: 00010000:00010000:0.0:1789302150.229508:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.229519:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302150.229618:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121427584:0@lo:501: 00000100:00100000:0.0:1789302150.229721:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.229810:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121427584 00000100:00100000:0.0:1789302150.229812:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302150.229817:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121427584 00000100:00100000:1.0:1789302150.229854:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789302150.229863:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121427584:12345-0@lo:501: 00000100:00100000:1.0:1789302150.229985:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121427584:12345-0@lo:501: Request processed in 123us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302150.229992:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789302150.230158:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121427584:0@lo:501: 00000100:00100000:0.0:1789302150.230184:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121427712:0@lo:503: 00000100:00100000:0.0:1789302150.230241:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.230271:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.230369:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121427712 00000100:00100000:2.0:1789302150.230374:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121427712 00000100:00100000:2.0:1789302150.230405:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789302150.230412:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121427712:12345-0@lo:503: 00000100:00100000:2.0:1789302150.230497:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121427712:12345-0@lo:503: Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.230504:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789302150.231843:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121427712:0@lo:503: 00000100:00100000:0.0:1789302150.233638:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10362:1876219121427840:0@lo:502: 00000100:00100000:0.0:1789302150.233702:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.233736:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789302150.233754:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121427840 00000100:00100000:1.0:1789302150.233763:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121427840 00000100:00100000:1.0:1789302150.233811:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789302150.233822:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+16:10362:x1876219121427840:12345-0@lo:502: 00000100:00100000:1.0:1789302150.233958:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+16:10362:x1876219121427840:12345-0@lo:502: Request processed in 138us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302150.233966:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789302150.234064:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10362:1876219121427840:0@lo:502: 00000100:00100000:0.0:1789302150.234104:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10362:1876219121427968:0@lo:502: 00000100:00100000:0.0:1789302150.234462:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302150.234641:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121427968 00000100:00100000:3.0:1789302150.234647:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121427968 00000100:00100000:0.0:1789302150.234655:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789302150.234687:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789302150.234695:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:10362:x1876219121427968:12345-0@lo:502: 00000100:00100000:3.0:1789302150.234788:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+16:10362:x1876219121427968:12345-0@lo:502: Request processed in 93us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.234796:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789302150.234823:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10362:1876219121427968:0@lo:502: 00000040:00080000:0.0:1789302150.234847:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789302150.236159:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789302150.236200:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789302150.236211:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.236224:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302150.236235:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789302150.236238:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789302150.236241:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789302150.236271:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.236296:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.236306:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302150.236324:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383441500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428096:0@lo:101: 00000100:00100000:3.0:1789302150.236368:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302150.236415:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302150.236729:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121428096 00000100:00100000:1.0:1789302150.236737:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121428096 00000100:00100000:1.0:1789302150.236782:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789302150.236790:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+16:6527:x1876219121428096:12345-0@lo:101: 00010000:00010000:1.0:1789302150.236801:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302150.236815:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4addd3000/0x1ff82925bd399308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399301 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.236837:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4addd3000/0x1ff82925bd399308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399301 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.236857:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4addd3000/0x1ff82925bd399308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399301 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.236866:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3000, rc 0) 00000100:00100000:1.0:1789302150.236908:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121428096:12345-0@lo:101: Request processed in 118us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302150.236915:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789302150.236941:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383441500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428096:0@lo:101: 00010000:00010000:0.0:1789302150.236956:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.236966:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302150.237036:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428224:0@lo:501: 00000100:00100000:0.0:1789302150.237063:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.237083:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789302150.237100:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121428224 00000100:00100000:1.0:1789302150.237105:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121428224 00000100:00100000:1.0:1789302150.237196:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789302150.237202:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121428224:12345-0@lo:501: 00000100:00100000:1.0:1789302150.237304:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121428224:12345-0@lo:501: Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302150.237311:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789302150.237372:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428224:0@lo:501: 00000100:00100000:0.0:1789302150.237397:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428352:0@lo:503: 00000100:00100000:0.0:1789302150.237430:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.237497:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.237524:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121428352 00000100:00100000:2.0:1789302150.237527:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121428352 00000100:00100000:2.0:1789302150.237552:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789302150.237556:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121428352:12345-0@lo:503: 00000100:00100000:2.0:1789302150.237658:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121428352:12345-0@lo:503: Request processed in 101us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.237662:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789302150.237737:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428352:0@lo:503: 00000100:00100000:2.0:1789302150.237956:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10363:1876219121428480:0@lo:502: 00000100:00100000:2.0:1789302150.237978:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302150.238014:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a6ef6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302150.238040:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121428480 00000100:00100000:3.0:1789302150.238045:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121428480 00000100:00100000:3.0:1789302150.238099:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789302150.238105:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:10363:x1876219121428480:12345-0@lo:502: 00000100:00100000:3.0:1789302150.238231:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+17:10363:x1876219121428480:12345-0@lo:502: Request processed in 125us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.238238:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789302150.238337:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10363:1876219121428480:0@lo:502: 00000020:01000000:2.0:1789302150.238356:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302150.238364:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302150.238366:0:10363:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789302150.238376:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789302150.238394:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10363:1876219121428608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302150.238425:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302150.238666:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a6ef6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302150.238805:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121428608 00000100:00100000:1.0:1789302150.238810:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121428608 00000100:00100000:1.0:1789302150.238834:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789302150.238841:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:10363:x1876219121428608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302150.238925:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:10363:x1876219121428608:12345-0@lo:502:llog_process_th.0 Request processed in 84us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302150.238932:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789302150.239003:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10363:1876219121428608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789302150.239021:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302150.239025:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302150.239027:0:10363:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789302150.239031:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1789302150.239375:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1789302150.239396:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789302150.239405:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.239414:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302150.239424:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789302150.239426:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4adc31000 from 48 10000000:01000000:3.0:1789302150.239429:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789302150.239451:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.239459:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.239469:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302150.239484:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383442300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789302150.239514:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302150.239539:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.239588:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121428736 00000100:00100000:2.0:1789302150.239593:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121428736 00000100:00100000:2.0:1789302150.239626:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789302150.239633:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+17:6527:x1876219121428736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302150.239651:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302150.239663:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5348400/0x1ff82925bd399316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39930f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.239681:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5348400/0x1ff82925bd399316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39930f expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.239692:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5348400/0x1ff82925bd399316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39930f expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.239699:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348400, rc 0) 00000100:00100000:2.0:1789302150.239727:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121428736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.239733:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789302150.239849:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383442300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302150.239860:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.239868:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302150.239918:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383442300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302150.239940:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302150.239961:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.240002:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121428864 00000100:00100000:2.0:1789302150.240006:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121428864 00000100:00100000:2.0:1789302150.240040:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789302150.240046:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121428864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302150.240273:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121428864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.240280:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789302150.240332:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383442300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302150.240359:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383442300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302150.240391:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302150.240419:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829573c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302150.240466:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121428992 00000100:00100000:0.0:1789302150.240470:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121428992 00000100:00100000:0.0:1789302150.240504:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789302150.240511:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121428992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.240580:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121428992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302150.240586:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789302150.240751:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383442300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121428992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.240951:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10364:1876219121429120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302150.240977:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.240993:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1789302150.241004:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121429120 00000100:00100000:0.0:1789302150.241008:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121429120 00000100:00100000:0.0:1789302150.241034:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789302150.241045:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:10364:x1876219121429120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302150.241288:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:10364:x1876219121429120:12345-0@lo:502:llog_process_th.0 Request processed in 243us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302150.241295:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789302150.241343:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10364:1876219121429120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302150.241382:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10364:1876219121429248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302150.241411:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.241437:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.241469:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121429248 00000100:00100000:2.0:1789302150.241472:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121429248 00000100:00100000:2.0:1789302150.241494:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789302150.241501:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+18:10364:x1876219121429248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302150.241594:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+18:10364:x1876219121429248:12345-0@lo:502:llog_process_th.0 Request processed in 94us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302150.241594:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10364:1876219121429248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302150.241601:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000040:00080000:1.0:1789302150.241610:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789302150.241770:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789302150.241793:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789302150.241799:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.241807:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302150.241813:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789302150.241814:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789302150.241816:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789302150.241832:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.241845:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.241851:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302150.241860:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121429376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.241878:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.241894:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.241908:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121429376 00000100:00100000:2.0:1789302150.241912:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121429376 00000100:00100000:2.0:1789302150.241940:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789302150.241947:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+18:6527:x1876219121429376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302150.241956:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302150.241966:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349600/0x1ff82925bd399324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39931d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.241984:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349600/0x1ff82925bd399324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39931d expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.241994:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5349600/0x1ff82925bd399324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39931d expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.242001:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349600, rc 0) 00000100:00100000:2.0:1789302150.242037:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121429376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302150.242046:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121429376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302150.242048:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00010000:00010000:0.0:1789302150.242056:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.242065:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302150.242107:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121429504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.242257:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.242307:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.242330:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121429504 00000100:00100000:2.0:1789302150.242334:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121429504 00000100:00100000:2.0:1789302150.242359:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789302150.242365:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121429504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302150.242446:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121429504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.242452:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789302150.242456:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121429504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.242481:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121429632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.242512:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.242528:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.242541:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121429632 00000100:00100000:2.0:1789302150.242544:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121429632 00000100:00100000:2.0:1789302150.242599:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789302150.242605:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121429632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302150.242674:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121429632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.242680:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789302150.242682:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121429632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.242887:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10365:1876219121429760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302150.242920:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.242939:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789302150.242972:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121429760 00000100:00100000:3.0:1789302150.242976:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121429760 00000100:00100000:3.0:1789302150.243003:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789302150.243009:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+19:10365:x1876219121429760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302150.243078:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+19:10365:x1876219121429760:12345-0@lo:502:llog_process_th.0 Request processed in 69us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.243084:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789302150.243087:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10365:1876219121429760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302150.243104:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302150.243129:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302150.243132:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789302150.243171:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789302150.243190:0:10365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10365:1876219121429888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302150.243220:0:10365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.243247:0:10365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c000 going to sleep for 11 seconds 00000100:00100000:1.0:1789302150.243253:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121429888 00000100:00100000:1.0:1789302150.243257:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121429888 00000100:00100000:1.0:1789302150.243281:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789302150.243287:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+19:10365:x1876219121429888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302150.243348:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+19:10365:x1876219121429888:12345-0@lo:502:llog_process_th.0 Request processed in 61us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302150.243354:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789302150.243355:0:10365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10365:1876219121429888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302150.243370:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302150.243374:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302150.243375:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789302150.243379:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1789302150.243508:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789302150.243526:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789302150.243534:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.243543:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302150.243552:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789302150.243554:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4b511e800 from 48 10000000:01000000:1.0:1789302150.243557:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789302150.243574:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.243582:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.243595:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302150.243607:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.243629:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.243644:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1789302150.243665:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121430016 00000100:00100000:0.0:1789302150.243670:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121430016 00000100:00100000:0.0:1789302150.243696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789302150.243702:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+19:6527:x1876219121430016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302150.243711:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302150.243721:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538e200/0x1ff82925bd399332 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39932b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.243739:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538e200/0x1ff82925bd399332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39932b expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.243748:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538e200/0x1ff82925bd399332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39932b expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.243767:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538e200, rc 0) 00000100:00100000:0.0:1789302150.243802:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121430016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302150.243808:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789302150.244167:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302150.244179:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.244188:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302150.244226:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.244246:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.244265:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.244308:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121430144 00000100:00100000:2.0:1789302150.244312:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121430144 00000100:00100000:2.0:1789302150.244335:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789302150.244340:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121430144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302150.244439:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121430144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.244443:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789302150.245293:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.245327:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.245361:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.245384:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1789302150.245391:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121430272 00000100:00100000:0.0:1789302150.245396:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121430272 00000100:00100000:0.0:1789302150.245430:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789302150.245437:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121430272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.245521:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121430272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302150.245528:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789302150.245730:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302150.246020:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383442300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10366:1876219121430400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302150.246056:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302150.246082:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.246104:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121430400 00000100:00100000:2.0:1789302150.246108:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121430400 00000100:00100000:2.0:1789302150.246206:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789302150.246213:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:10366:x1876219121430400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302150.246466:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:10366:x1876219121430400:12345-0@lo:502:llog_process_th.0 Request processed in 252us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.246473:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789302150.246524:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383442300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10366:1876219121430400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302150.246567:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10366:1876219121430528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302150.246597:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.246625:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302150.246671:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121430528 00000100:00100000:3.0:1789302150.246675:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121430528 00000100:00100000:3.0:1789302150.246736:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789302150.246743:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:10366:x1876219121430528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302150.246809:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:10366:x1876219121430528:12345-0@lo:502:llog_process_th.0 Request processed in 67us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.246816:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789302150.246871:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10366:1876219121430528:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789302150.246889:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789302150.247690:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789302150.247719:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789302150.247728:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.247753:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302150.247763:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789302150.247766:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1789302150.247768:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789302150.247794:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.247803:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.247812:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302150.247827:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.247859:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.247886:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.247923:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121430656 00000100:00100000:2.0:1789302150.247929:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121430656 00000100:00100000:2.0:1789302150.247966:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789302150.247973:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121430656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302150.247982:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302150.247993:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349a00/0x1ff82925bd399340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399339 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.248012:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349a00/0x1ff82925bd399340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399339 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.248021:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5349a00/0x1ff82925bd399340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399339 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.248036:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349a00, rc 0) 00000100:00100000:2.0:1789302150.248102:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121430656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.248109:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789302150.248308:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302150.248320:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.248326:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302150.248361:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.248378:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.248400:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789302150.248434:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121430784 00000100:00100000:3.0:1789302150.248440:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121430784 00000100:00100000:3.0:1789302150.248470:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789302150.248479:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121430784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302150.248574:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121430784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.248579:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789302150.248601:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.248629:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.248664:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.248687:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.248726:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121430912 00000100:00100000:2.0:1789302150.248730:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121430912 00000100:00100000:2.0:1789302150.248756:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789302150.248762:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121430912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302150.248872:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121430912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.248887:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789302150.248936:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121430912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302150.250594:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10367:1876219121431040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302150.250655:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302150.250691:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc483b37480 going to sleep for 11 seconds 00000100:00100000:3.0:1789302150.250745:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121431040 00000100:00100000:3.0:1789302150.250751:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121431040 00000100:00100000:3.0:1789302150.250803:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789302150.250812:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:10367:x1876219121431040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302150.250936:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:10367:x1876219121431040:12345-0@lo:502:llog_process_th.0 Request processed in 124us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.250948:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789302150.251085:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10367:1876219121431040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789302150.251157:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302150.251166:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302150.251168:0:10367:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789302150.251174:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789302150.251194:0:10367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10367:1876219121431168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302150.251342:0:10367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302150.251372:0:10367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7ef6840 going to sleep for 11 seconds 00000100:00100000:1.0:1789302150.251384:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121431168 00000100:00100000:1.0:1789302150.251389:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121431168 00000100:00100000:1.0:1789302150.251421:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789302150.251428:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:10367:x1876219121431168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302150.251513:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:10367:x1876219121431168:12345-0@lo:502:llog_process_th.0 Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302150.251520:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789302150.251554:0:10367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10367:1876219121431168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302150.251574:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302150.251578:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302150.251580:0:10367:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789302150.251584:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1789302150.251639:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1789302150.251661:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789302150.251671:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.251682:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302150.251692:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789302150.251694:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4b863d000 from 48 10000000:01000000:1.0:1789302150.251697:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789302150.251716:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.251723:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.251737:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302150.251749:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121431296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.251771:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.251796:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302150.251920:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121431296 00000100:00100000:3.0:1789302150.251925:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121431296 00000100:00100000:3.0:1789302150.251956:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789302150.251964:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121431296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302150.251973:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302150.251992:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166e200/0x1ff82925bd39934e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399347 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.252013:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166e200/0x1ff82925bd39934e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399347 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.252023:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166e200/0x1ff82925bd39934e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399347 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.252031:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166e200, rc 0) 00000100:00100000:3.0:1789302150.252074:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121431296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.252080:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789302150.252245:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121431296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302150.252257:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302150.253216:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302150.253283:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121431424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.253320:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.253345:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.253439:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121431424 00000100:00100000:2.0:1789302150.253445:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121431424 00000100:00100000:2.0:1789302150.253482:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789302150.253491:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121431424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302150.253675:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121431424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.253682:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789302150.253945:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121431424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.253974:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121431552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.254013:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.254035:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302150.254081:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121431552 00000100:00100000:3.0:1789302150.254086:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121431552 00000100:00100000:3.0:1789302150.254154:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789302150.254163:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121431552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302150.254248:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121431552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.254255:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789302150.254377:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121431552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.255212:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10368:1876219121431680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302150.255253:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.255288:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789302150.255385:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121431680 00000100:00100000:3.0:1789302150.255391:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121431680 00000100:00100000:3.0:1789302150.255421:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789302150.255428:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:10368:x1876219121431680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302150.255532:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:10368:x1876219121431680:12345-0@lo:502:llog_process_th.0 Request processed in 104us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.255539:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789302150.255763:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10368:1876219121431680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302150.255810:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10368:1876219121431808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302150.255850:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.255870:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789302150.255960:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121431808 00000100:00100000:3.0:1789302150.255969:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121431808 00000100:00100000:3.0:1789302150.255995:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789302150.256002:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:10368:x1876219121431808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302150.256070:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:10368:x1876219121431808:12345-0@lo:502:llog_process_th.0 Request processed in 68us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.256077:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789302150.256227:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10368:1876219121431808:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789302150.256246:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789302150.256474:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789302150.256497:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789302150.256513:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.256523:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302150.256532:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789302150.256535:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1789302150.256537:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789302150.256561:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.256569:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.256579:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302150.256594:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121431936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.256625:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.256656:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302150.256707:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121431936 00000100:00100000:3.0:1789302150.256711:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121431936 00000100:00100000:3.0:1789302150.256743:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789302150.256750:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121431936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302150.256759:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302150.256772:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166ee00/0x1ff82925bd39935c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399355 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.256793:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166ee00/0x1ff82925bd39935c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399355 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.256803:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166ee00/0x1ff82925bd39935c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399355 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.256811:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166ee00, rc 0) 00000100:00100000:3.0:1789302150.256859:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121431936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.256865:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789302150.256977:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121431936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302150.256989:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302150.256998:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302150.257044:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121432064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.257078:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.257098:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.257180:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121432064 00000100:00100000:2.0:1789302150.257184:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121432064 00000100:00100000:2.0:1789302150.257213:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789302150.257220:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121432064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302150.257333:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121432064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.257348:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789302150.257451:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121432064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.257477:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121432192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.257514:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.257537:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302150.257585:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121432192 00000100:00100000:1.0:1789302150.257589:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121432192 00000100:00100000:1.0:1789302150.257605:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789302150.257610:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121432192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302150.257681:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121432192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302150.257687:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789302150.257979:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121432192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.258394:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10369:1876219121432320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302150.258426:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.258450:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302150.258486:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121432320 00000100:00100000:1.0:1789302150.258490:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121432320 00000100:00100000:1.0:1789302150.258542:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789302150.258549:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:10369:x1876219121432320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302150.258625:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:10369:x1876219121432320:12345-0@lo:502:llog_process_th.0 Request processed in 76us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302150.258632:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789302150.258681:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10369:1876219121432320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302150.258699:0:10369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302150.258706:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302150.258708:0:10369:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789302150.258714:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789302150.258730:0:10369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10369:1876219121432448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302150.258756:0:10369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302150.259341:0:10369:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302150.259423:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121432448 00000100:00100000:2.0:1789302150.259428:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121432448 00000100:00100000:2.0:1789302150.259452:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789302150.259458:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:10369:x1876219121432448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302150.259535:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:10369:x1876219121432448:12345-0@lo:502:llog_process_th.0 Request processed in 76us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.259542:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789302150.259599:0:10369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10369:1876219121432448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302150.259616:0:10369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302150.259620:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302150.259622:0:10369:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789302150.259625:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789302150.259753:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1789302150.259772:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789302150.259779:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.259885:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302150.259896:0:6527:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789302150.259898:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cc4ac2ab380 from 1 10000000:01000000:2.0:1789302150.259901:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789302150.259923:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd399363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.259931:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd399363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.259940:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd399363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302150.259953:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121432576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302150.259985:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302150.260031:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7ef6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789302150.260071:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121432576 00000100:00100000:1.0:1789302150.260075:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121432576 00000100:00100000:3.0:1789302150.260251:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789302150.260261:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121432576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302150.260288:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302150.260304:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd39936a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399363 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.260325:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd39936a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399363 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.260334:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd39936a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399363 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302150.260342:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166fa00, rc 0) 00000100:00100000:3.0:1789302150.260376:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121432576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302150.260382:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789302150.260429:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121432576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302150.260440:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd399363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39936a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.260449:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd399363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39936a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302150.260488:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121432704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302150.260509:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302150.260692:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7ef6240 going to sleep for 11 seconds 00000100:00100000:0.0:1789302150.260715:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121432704 00000100:00100000:0.0:1789302150.260719:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121432704 00000100:00100000:0.0:1789302150.260742:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789302150.260747:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121432704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302150.260813:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121432704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (303us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302150.260879:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789302150.260976:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121432704:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789302150.260995:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789302150.261000:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd399363 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39936a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.261008:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd399363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39936a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302150.552225:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302150.740367:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302150.741762:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121432832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302150.741827:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302150.741939:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121432832 00000100:00100000:2.0:1789302150.741948:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121432832 00000100:00100000:2.0:1789302150.742008:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789302150.742018:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121432832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789302150.742044:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302150.742086:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121432832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302150.742104:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789302150.742263:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302150.742272:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121432960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302150.742298:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302150.742322:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121432960 00000100:00100000:1.0:1789302150.742332:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121432960 00000100:00100000:1.0:1789302150.742359:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789302150.742365:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121432960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302150.742375:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302150.742401:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121432960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302150.742407:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789302150.742437:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bdbb4700 x1876219121432960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302150.742453:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121432960:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789302150.742655:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302150.742676:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a14000 x1876219121432832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302150.742688:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121432832:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789302151.572330:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302152.277746:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121433344:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.277815:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302152.277878:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121433856:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.277902:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302152.277921:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121434368:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.277938:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302152.277981:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789302152.277987:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121433472:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.278019:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302152.278041:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121433984:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.278064:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302152.278082:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121434496:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.278101:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302152.278172:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121433856 00000100:00100000:3.0:1789302152.278179:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121433856 00000100:00100000:3.0:1789302152.278228:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121434368 00000100:00100000:3.0:1789302152.278230:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121434368 00000100:00100000:3.0:1789302152.278272:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121433472 00000100:00100000:3.0:1789302152.278275:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121433472 00000100:00100000:3.0:1789302152.278305:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789302152.278313:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121433856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.278372:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121433856:12345-0@lo:400:kworker.0 Request processed in 59us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302152.278379:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789302152.278404:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789302152.278410:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121434368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.278438:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121434368:12345-0@lo:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302152.278445:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789302152.278465:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789302152.278472:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121433472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302152.278484:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121433088:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.278499:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121433472:12345-0@lo:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302152.278517:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789302152.278531:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789302152.278554:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789302152.278562:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121433600:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.278592:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121433472:0@lo:400:kworker.0 00000100:00100000:1.0:1789302152.278593:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789302152.278615:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f09f80 x1876219121433856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302152.278620:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121434112:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.278633:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121433856:0@lo:400:kworker.0 00000100:00100000:1.0:1789302152.278651:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302152.278667:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121434624:0@lo:400:kworker.0 00000100:00100000:1.0:1789302152.278687:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302152.278708:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789302152.278714:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121433216:0@lo:400:kworker.0 00000100:00100000:1.0:1789302152.278736:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302152.278754:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121433728:0@lo:400:kworker.0 00000100:00100000:1.0:1789302152.278773:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302152.278803:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121434240:0@lo:400:kworker.0 00000100:00100000:1.0:1789302152.278837:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302152.278862:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121433984 00000100:00100000:1.0:1789302152.278866:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121433984 00000100:00100000:1.0:1789302152.278894:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121434496 00000100:00100000:1.0:1789302152.278898:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121434496 00000100:00100000:1.0:1789302152.278911:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121434112 00000100:00100000:1.0:1789302152.278913:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121434112 00000100:00100000:1.0:1789302152.278925:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121434624 00000100:00100000:1.0:1789302152.278928:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121434624 00000100:00100000:1.0:1789302152.278943:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789302152.278950:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121433984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302152.278977:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121433344 00000100:00100000:0.0:1789302152.278983:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121433344 00000100:00100000:1.0:1789302152.278988:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121433984:12345-0@lo:400:kworker.0 Request processed in 37us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302152.278996:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789302152.279010:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789302152.279017:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121434496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302152.279030:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121433600 00000100:00100000:0.0:1789302152.279034:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121433600 00000100:00100000:0.0:1789302152.279051:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789302152.279057:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121433344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302152.279094:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121433344:12345-0@lo:400:kworker.0 Request processed in 37us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302152.279100:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789302152.279236:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789302152.279245:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121433600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302152.279365:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121434496:12345-0@lo:400:kworker.0 Request processed in 348us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302152.279385:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789302152.279403:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f09c00 x1876219121434368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302152.279403:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302152.279415:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121434112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.279423:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121434368:0@lo:400:kworker.0 00000100:00100000:0.0:1789302152.279475:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121433600:12345-0@lo:400:kworker.0 Request processed in 231us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302152.279480:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789302152.279502:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789302152.279510:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121434624:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789302152.279566:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f0b800 x1876219121433984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302152.279576:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121433984:0@lo:400:kworker.0 00010000:00080000:3.0:1789302152.279588:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f0b100 x1876219121434496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302152.279596:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121434496:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.279607:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121433344:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.279733:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121433216 00000100:00100000:3.0:1789302152.279738:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121433216 00000100:00100000:3.0:1789302152.279760:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121433728 00000100:00100000:3.0:1789302152.279763:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121433728 00000100:00100000:3.0:1789302152.279775:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121434240 00000100:00100000:3.0:1789302152.279778:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121434240 00000100:00100000:3.0:1789302152.279791:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789302152.279797:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121433216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302152.282519:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121434752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302152.283804:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121434624:12345-0@lo:400:kworker.0 Request processed in 4290us (5110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302152.283817:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789302152.283866:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789302152.283881:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121433728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302152.283956:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121433728:12345-0@lo:400:kworker.0 Request processed in 82us (5182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302152.283962:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789302152.283983:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789302152.283990:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121434240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302152.284028:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121434240:12345-0@lo:400:kworker.0 Request processed in 38us (5190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302152.284033:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789302152.284084:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121433216:0@lo:400:kworker.0 00000100:00100000:0.0:1789302152.284096:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121433728:0@lo:400:kworker.0 00000100:00100000:0.0:1789302152.284107:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121434240:0@lo:400:kworker.0 00000100:00100000:2.0:1789302152.284178:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302152.284194:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121434112:12345-0@lo:400:kworker.0 Request processed in 4779us (5541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302152.284204:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789302152.284234:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302152.284236:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121434752 00000100:00080000:1.0:1789302152.284240:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302152.284244:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302152.284249:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121434752 00000100:00100000:2.0:1789302152.284307:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789302152.284317:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121434752:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302152.284337:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121433088 00000004:00000024:2.0:1789302152.284345:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789302152.284349:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121433088 00000100:00100000:1.0:1789302152.284380:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789302152.284388:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121433088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302152.284395:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121434752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302152.284403:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789302152.284429:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121433088:12345-0@lo:400:kworker.0 Request processed in 43us (5899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302152.284437:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789302152.284447:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121434752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302152.286498:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121433088:0@lo:400:kworker.0 00000100:00100000:0.0:1789302152.286512:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121433600:0@lo:400:kworker.0 00010000:00080000:0.0:1789302152.286525:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f08380 x1876219121434112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302152.286536:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121434112:0@lo:400:kworker.0 00010000:00080000:0.0:1789302152.286548:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f0ad80 x1876219121434624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302152.286556:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121434624:0@lo:400:kworker.0 00000100:00100000:3.0:1789302152.287738:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121433216:12345-0@lo:400:kworker.0 Request processed in 7935us (8995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302152.287750:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789302152.530550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302152.530851:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101451776 00000100:00100000:3.0:1789302152.530866:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101451776 00000100:00100000:3.0:1789302152.530955:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 244 00000100:00100000:3.0:1789302152.530968:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48534b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:6168:x1876219101451776:12345-192.168.203.9@tcp:101: 00010000:00010000:3.0:1789302152.530991:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302152.531013:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166f200/0x1ff82925bd399371 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5947 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302152.531050:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166f200/0x1ff82925bd399371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5947 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302152.531068:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166f200/0x1ff82925bd399371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5947 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302152.531079:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f200, rc 0) 00000100:00100000:3.0:1789302152.531211:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48534b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6168:x1876219101451776:12345-192.168.203.9@tcp:101: Request processed in 246us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302152.531219:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 244 00000100:00100000:1.0:1789302152.544232:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302152.544502:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101451904 00000100:00100000:2.0:1789302152.544511:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101451904 00000100:00100000:2.0:1789302152.544571:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 245 00000100:00100000:2.0:1789302152.544582:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6168:x1876219101451904:12345-192.168.203.9@tcp:501: 00000100:00100000:2.0:1789302152.544739:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6168:x1876219101451904:12345-192.168.203.9@tcp:501: Request processed in 158us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302152.544746:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 245 00000100:00100000:2.0:1789302152.552196:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302152.552477:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101452032 00000100:00100000:0.0:1789302152.552487:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101452032 00000100:00100000:0.0:1789302152.552548:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 246 00000100:00100000:0.0:1789302152.552574:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4883a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6168:x1876219101452032:12345-192.168.203.9@tcp:503: 00000100:00100000:0.0:1789302152.553223:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4883a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6168:x1876219101452032:12345-192.168.203.9@tcp:503: Request processed in 646us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302152.553232:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 246 00000100:00100000:0.0:1789302152.568629:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302152.568967:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101452160 00000100:00100000:3.0:1789302152.568979:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101452160 00000100:00100000:3.0:1789302152.569054:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 247 00000100:00100000:3.0:1789302152.569064:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4883a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6661:x1876219101452160:12345-192.168.203.9@tcp:502: 00000100:00100000:3.0:1789302152.569274:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4883a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6661:x1876219101452160:12345-192.168.203.9@tcp:502: Request processed in 211us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302152.569291:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 247 00000100:00100000:1.0:1789302152.572358:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302152.572651:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101452288 00000100:00100000:0.0:1789302152.572661:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101452288 00000100:00100000:0.0:1789302152.572724:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 248 00000100:00100000:0.0:1789302152.572736:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6661:x1876219101452288:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302152.573285:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6661:x1876219101452288:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 550us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302152.573293:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 248 00000100:00100000:0.0:1789302152.579324:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302152.580980:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101452416 00000100:00100000:2.0:1789302152.580993:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101452416 00000100:00100000:2.0:1789302152.581203:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 249 00000100:00100000:2.0:1789302152.581215:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6168:x1876219101452416:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302152.581248:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302152.581267:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5348a00/0x1ff82925bd399378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a594e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302152.581294:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5348a00/0x1ff82925bd399378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a594e expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302152.581305:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5348a00/0x1ff82925bd399378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a594e expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302152.581313:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348a00, rc 0) 00000100:00100000:2.0:1789302152.581491:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6168:x1876219101452416:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 Request processed in 278us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302152.581498:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 249 00000100:00100000:2.0:1789302152.593737:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302152.593841:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101452544 00000100:00100000:3.0:1789302152.593851:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101452544 00000100:00100000:3.0:1789302152.593917:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 250 00000100:00100000:3.0:1789302152.593925:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6168:x1876219101452544:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302152.594416:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6168:x1876219101452544:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 Request processed in 490us (686us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302152.594424:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 250 00010000:00010000:2.0:1789302152.596343:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302152.788822:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302152.788846:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121434880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302152.788914:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302152.789563:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121434880 00000100:00100000:2.0:1789302152.789570:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121434880 00000100:00100000:2.0:1789302152.789632:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789302152.789642:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121434880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789302152.789668:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302152.789709:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121434880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302152.789715:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789302152.790027:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121435008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302152.790056:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789302152.790097:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a17100 x1876219121434880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302152.790156:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121434880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302152.791829:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121435008 00000100:00100000:2.0:1789302152.791840:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121435008 00000100:00100000:2.0:1789302152.791891:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789302152.791899:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121435008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302152.791932:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302152.791992:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121435008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302152.791999:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789302152.792202:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f0ad80 x1876219121435008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302152.792229:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121435008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302153.300925:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121435136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302153.300993:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302153.301195:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121435136 00000100:00100000:2.0:1789302153.301202:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121435136 00000100:00100000:2.0:1789302153.301244:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789302153.301253:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121435136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302153.301294:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789302153.303499:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121435136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2241us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302153.303512:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789302153.304431:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121435136:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789302153.623153:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789302153.816888:0:10406:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe50622510 20000000:00000080:1.0:1789302153.816904:0:10406:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cc383a3d800 uarg=0000000000000000 20000000:01000000:1.0:1789302153.816943:0:10406:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789302153.816950:0:10406:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789302153.816954:0:10406:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789302153.817386:0:10407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789302153.817636:0:10406:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789302153.822666:0:10406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789302153.822706:0:10406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789302153.822723:0:10406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789302153.822740:0:10406:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789302153.822761:0:10406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.822780:0:10406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa982c00/0x1ff82925bd39901b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399014 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.822788:0:10406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd399029 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399022 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.822915:0:10406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4c2179200/0x1ff82925bd39907d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399076 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.822921:0:10406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd3991a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39919c expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.822930:0:10406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd3992bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a590f expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.822937:0:10406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.822978:0:10406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd3992bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a590f expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.822991:0:10406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd3992bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a590f expref: 9 pid: 6525 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302153.823006:0:10406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1876219121435264:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302153.823201:0:10406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd3991a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39919c expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.823211:0:10406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd3991a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39919c expref: 23 pid: 6524 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302153.823220:0:10406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1876219121435392:0@lo:104: 00000100:00100000:1.0:1789302153.823260:0:10406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302153.823350:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121435392 00000100:00100000:3.0:1789302153.823358:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121435392 00000100:00100000:3.0:1789302153.823414:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789302153.823425:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:10406:x1876219121435392:12345-0@lo:104: 00010000:00010000:3.0:1789302153.823443:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.823498:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302153.823504:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:10406:x1876219121435392:12345-0@lo:104: Request processed in 82us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302153.823511:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1789302153.823544:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302153.823550:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.823559:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983600 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302153.823564:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.823573:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302153.823581:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302153.823587:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789302153.823619:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.823626:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302153.823647:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.823654:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983600/0x1ff82925bd39919c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3991a3 expref: -99 pid: 9523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.823674:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302153.823675:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302153.823677:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302153.824472:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121435520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302153.824513:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302153.824938:0:10406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4c2179200/0x1ff82925bd39907d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399076 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.824974:0:10406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4c2179200/0x1ff82925bd39907d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399076 expref: 23 pid: 6524 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302153.824999:0:10406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1876219121435648:0@lo:104: 00000100:00100000:1.0:1789302153.825057:0:10406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302153.825161:0:10406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd399029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399022 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.825172:0:10406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd399029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399022 expref: 23 pid: 6525 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302153.825182:0:10406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1876219121435776:0@lo:104: 00010000:00010000:1.0:1789302153.825288:0:10406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa982c00/0x1ff82925bd39901b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399014 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.825307:0:10406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4aa982c00/0x1ff82925bd39901b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399014 expref: 23 pid: 6525 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302153.825317:0:10406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1876219121435904:0@lo:104: 00000100:00100000:1.0:1789302153.825358:0:10406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48876c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302153.826302:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789302153.826347:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302153.826590:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302153.826634:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121435648 00000100:00100000:2.0:1789302153.826641:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121435648 00000100:00100000:2.0:1789302153.826690:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121435776 00000100:00100000:2.0:1789302153.826694:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121435776 00000100:00100000:2.0:1789302153.826714:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121435904 00000100:00100000:2.0:1789302153.826718:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121435904 00000100:00100000:2.0:1789302153.826743:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302153.826755:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383445850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:10406:x1876219121435648:12345-0@lo:104: 00010000:00010000:2.0:1789302153.826770:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302153.826833:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789302153.826849:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383445850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:10406:x1876219121435648:12345-0@lo:104: Request processed in 97us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302153.826858:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302153.826915:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789302153.826924:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:10406:x1876219121435776:12345-0@lo:104: 00010000:00010000:2.0:1789302153.826933:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302153.827274:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121435520 00000100:00100000:3.0:1789302153.827280:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121435520 00010000:00010000:3.0:1789302153.827303:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd3991a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39919c expref: 24 pid: 6524 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302153.827327:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302153.827333:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383441c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121435520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302153.827341:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302153.827345:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd3991a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39919c expref: 24 pid: 6524 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.827353:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd3991a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39919c expref: 24 pid: 6524 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.827371:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302153.827492:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383441c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121435520:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (2979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302153.827498:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1789302153.827552:0:10406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd3991a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39919c expref: 23 pid: 6524 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302153.827563:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302153.827569:0:10406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1876219121435392:0@lo:104: 00000100:00100000:3.0:1789302153.827586:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101452672 00000100:00100000:3.0:1789302153.827591:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101452672 00010000:00010000:3.0:1789302153.827605:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd3992bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a590f expref: 10 pid: 6525 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302153.827637:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 36 00000100:00100000:3.0:1789302153.827645:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2398:x1876219101452672:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302153.827654:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789302153.827656:0:10406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1876219121435648:0@lo:104: 00010000:00010000:3.0:1789302153.827659:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd3992bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a590f expref: 10 pid: 6525 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302153.827671:0:10406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1876219121435776:0@lo:104: 00010000:00010000:3.0:1789302153.827672:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd3992bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a590f expref: 10 pid: 6525 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.827686:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302153.827692:0:10406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd3992bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a590f expref: 10 pid: 6525 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302153.827713:0:10406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1876219121435264:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302153.827716:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:2398:x1876219101452672:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 72us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302153.827724:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 36 00000100:00100000:3.0:1789302153.827804:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121435520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302153.828546:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302153.828554:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.828564:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166fe00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302153.828569:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.828579:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302153.828586:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302153.828586:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302153.828591:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302153.828598:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538e400 already unused, calling callback (ffffffffc13cfc20) 10000000:01000000:3.0:1789302153.828600:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:0.0:1789302153.828601:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302153.828607:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302153.828613:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302153.828618:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789302153.828638:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302153.828639:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.828646:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302153.828646:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302153.828655:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.828662:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd399076 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39907d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302153.828663:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302153.828670:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e400/0x1ff82925bd399022 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399029 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.828675:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302153.828677:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302153.828678:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302153.828679:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302153.828679:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302153.828681:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302153.828701:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121436032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302153.828740:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302153.828798:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121436160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302153.828799:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789302153.828811:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:10406:x1876219121435776:12345-0@lo:104: Request processed in 1888us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302153.828821:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302153.828827:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302153.828846:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789302153.828857:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:10406:x1876219121435904:12345-0@lo:104: 00010000:00010000:2.0:1789302153.828866:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f400/0x1ff82925bd399014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302153.828935:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121436032 00000100:00100000:1.0:1789302153.828941:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121436032 00000100:00100000:0.0:1789302153.828956:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121436160 00000100:00100000:0.0:1789302153.828962:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121436160 00010000:00010000:0.0:1789302153.828980:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4c2179200/0x1ff82925bd39907d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399076 expref: 24 pid: 6524 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302153.828999:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789302153.829003:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121436160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302153.829012:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302153.829016:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4c2179200/0x1ff82925bd39907d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399076 expref: 24 pid: 6524 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302153.829025:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4c2179200/0x1ff82925bd39907d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399076 expref: 24 pid: 6524 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302153.829037:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2179200/0x1ff82925bd39907d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399076 expref: 24 pid: 6524 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302153.829046:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302153.829053:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd399029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399022 expref: 23 pid: 6525 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302153.829074:0:6516:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789302153.829083:0:6516:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789302153.829089:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+23:3647:x1876219121436160:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302153.829096:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789302153.829143:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789302153.829152:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+22:3647:x1876219121436032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302153.829153:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302153.829157:0:10406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10406:1876219121435904:0@lo:104: 00010000:00010000:0.0:1789302153.829161:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789302153.829165:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:10406:x1876219121435904:12345-0@lo:104: Request processed in 308us (2575us total) trans 0 rc 0/0 00010000:00010000:0.0:1789302153.829168:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd399029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399022 expref: 22 pid: 6525 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302153.829180:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1789302153.829184:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd399029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399022 expref: 22 pid: 6525 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829194:0:10406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302153.829197:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd399029 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399022 expref: 22 pid: 6525 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302153.829201:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302153.829208:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302153.829209:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f400/0x1ff82925bd399014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302153.829218:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f400 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302153.829222:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f400/0x1ff82925bd399014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302153.829232:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+21:3647:x1876219121436032:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (491us total) trans 0 rc 0/0 00010000:00010000:2.0:1789302153.829251:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f400/0x1ff82925bd399014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302153.829251:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 10000000:00010000:2.0:1789302153.829261:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f400/0x1ff82925bd399014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302153.829267:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789302153.829300:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f400/0x1ff82925bd399014 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302153.829308:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789302153.829322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121436032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302153.829325:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f400/0x1ff82925bd399014 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302153.829333:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f400/0x1ff82925bd399014 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39901b expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302153.829334:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121436160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302153.829355:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302153.829356:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302153.829359:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302153.829363:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302153.829370:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121436288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302153.829393:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302153.829477:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121436288 00000100:00100000:3.0:1789302153.829481:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121436288 00010000:00010000:3.0:1789302153.829493:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa982c00/0x1ff82925bd39901b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399014 expref: 21 pid: 6525 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302153.829534:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789302153.829547:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+21:3647:x1876219121436288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302153.829555:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302153.829560:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa982c00/0x1ff82925bd39901b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399014 expref: 21 pid: 6525 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829569:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa982c00/0x1ff82925bd39901b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399014 expref: 21 pid: 6525 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829579:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa982c00/0x1ff82925bd39901b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399014 expref: 21 pid: 6525 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829589:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829597:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829615:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829623:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829630:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829637:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829642:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2000 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302153.829646:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829657:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829672:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302153.829681:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302153.829700:0:10406:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302153.829708:0:10406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302153.829716:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+20:3647:x1876219121436288:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (322us total) trans 0 rc 0/0 00010000:00010000:0.0:1789302153.829720:0:10406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd39937f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302153.829722:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789302153.830247:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121436288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302153.884091:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302153.884808:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101452800 00000100:00100000:1.0:1789302153.884820:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101452800 00000100:00100000:1.0:1789302153.884879:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 251 00000100:00100000:1.0:1789302153.884889:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:6168:x1876219101452800:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302153.884913:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302153.884938:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4addd2a00/0x1ff82925bd399386 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5955 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.884980:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4addd2a00/0x1ff82925bd399386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5955 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.884990:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4addd2a00/0x1ff82925bd399386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5955 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302153.885014:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2a00, rc 0) 00000100:00100000:1.0:1789302153.885079:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6168:x1876219101452800:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 Request processed in 191us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302153.885102:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 251 00000100:00100000:3.0:1789302153.888158:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302153.888245:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101452928 00000100:00100000:1.0:1789302153.888263:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101452928 00000100:00100000:1.0:1789302153.889416:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 252 00000100:00100000:1.0:1789302153.889429:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6168:x1876219101452928:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302153.889571:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6168:x1876219101452928:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 Request processed in 144us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302153.889579:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 252 00000100:00100000:2.0:1789302153.893539:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302153.893624:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101453056 00000100:00100000:1.0:1789302153.893641:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101453056 00000100:00100000:1.0:1789302153.893715:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 253 00000100:00100000:1.0:1789302153.893730:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6168:x1876219101453056:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302153.893891:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6168:x1876219101453056:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 Request processed in 166us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302153.893899:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 253 00000100:00100000:1.0:1789302153.900595:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302153.900702:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101453184 00000100:00100000:2.0:1789302153.900712:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101453184 00000100:00100000:2.0:1789302153.900779:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 254 00000100:00100000:2.0:1789302153.900790:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6688:x1876219101453184:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789302153.900938:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6688:x1876219101453184:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 150us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302153.900955:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 254 00000100:00100000:1.0:1789302153.904328:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302153.906133:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101453312 00000100:00100000:0.0:1789302153.906146:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101453312 00000100:00100000:0.0:1789302153.906205:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 255 00000100:00100000:0.0:1789302153.906216:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6688:x1876219101453312:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302153.906363:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:6688:x1876219101453312:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 148us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302153.906371:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 255 00010000:00010000:3.0:1789302154.652010:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302155.095504:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302155.095538:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302155.095574:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302155.095595:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302155.095632:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302155.095816:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101453568 00000100:00100000:1.0:1789302155.095826:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101453568 00000100:00100000:1.0:1789302155.095894:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101453696 00000100:00100000:0.0:1789302155.095894:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101453824 00000100:00100000:1.0:1789302155.095899:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101453696 00000100:00100000:0.0:1789302155.095902:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101453824 00000100:00100000:1.0:1789302155.095935:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 71 00000100:00100000:0.0:1789302155.095947:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101453952 00000100:00100000:1.0:1789302155.095948:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2397:x1876219101453568:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302155.095952:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101453952 00000100:00100000:0.0:1789302155.095982:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:0.0:1789302155.095992:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101453824:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302155.096030:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2397:x1876219101453568:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 84us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302155.096031:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101453824:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 40us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302155.096047:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:1.0:1789302155.096050:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 71 00000100:00100000:0.0:1789302155.096070:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:1.0:1789302155.096076:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:0.0:1789302155.096081:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101453952:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302155.096088:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101453696:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302155.096160:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101453952:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 81us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302155.096167:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00080000:2.0:1789302155.096273:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302155.096279:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302155.096283:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302155.096286:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302155.096603:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101453696:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 517us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302155.096610:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:1.0:1789302155.096630:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101453440 00000100:00100000:1.0:1789302155.096635:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101453440 00000100:00100000:1.0:1789302155.096702:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 256 00000100:00100000:1.0:1789302155.096713:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2397:x1876219101453440:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302155.096741:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2397:x1876219101453440:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 30us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302155.096749:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 256 10000000:01000000:0.0:1789302155.479542:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789302155.479550:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc382b0f800 from 4 10000000:01000000:0.0:1789302155.479555:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302155.479608:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302155.479620:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302155.479632:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302155.479655:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121436416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302155.479717:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302155.479767:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302155.479947:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121436416 00000100:00100000:2.0:1789302155.479957:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121436416 00000100:00100000:2.0:1789302155.480014:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789302155.480023:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121436416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302155.480035:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302155.480048:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd399394 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39938d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302155.480069:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd399394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39938d expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302155.480079:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd399394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39938d expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302155.480088:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349000, rc 0) 00000100:00100000:2.0:1789302155.480301:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121436416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 279us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302155.480308:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789302155.480721:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121436416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302155.480739:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302155.480749:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302155.480826:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121436544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302155.480856:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302155.480889:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302155.481398:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121436544 00000100:00100000:2.0:1789302155.481406:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121436544 00000100:00100000:2.0:1789302155.481453:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789302155.481461:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121436544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302155.481574:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121436544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302155.481588:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789302155.482763:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121436544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302155.482836:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121436672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302155.482899:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302155.482936:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302155.484538:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121436672 00000100:00100000:2.0:1789302155.484549:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121436672 00000100:00100000:2.0:1789302155.484595:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789302155.484603:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121436672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302155.484751:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121436672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302155.484758:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789302155.485018:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121436672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302155.487086:0:10505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10505:1876219121436800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302155.487186:0:10505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302155.487225:0:10505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0c9db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302155.488249:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121436800 00000100:00100000:1.0:1789302155.488259:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121436800 00000100:00100000:1.0:1789302155.488305:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789302155.488315:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:10505:x1876219121436800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302155.488636:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:10505:x1876219121436800:12345-0@lo:502:llog_process_th.0 Request processed in 322us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302155.488644:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789302155.488741:0:10505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10505:1876219121436800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302155.488794:0:10505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302155.488804:0:10505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302155.488806:0:10505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789302155.488814:0:10505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc382b0f800 00000020:00000080:0.0:1789302155.488817:0:10505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789302155.488898:0:10505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10505:1876219121436928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302155.488937:0:10505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302155.488971:0:10505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302155.491629:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121436928 00000100:00100000:3.0:1789302155.491644:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121436928 00000100:00100000:3.0:1789302155.491695:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789302155.491704:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:10505:x1876219121436928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302155.491873:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:10505:x1876219121436928:12345-0@lo:502:llog_process_th.0 Request processed in 169us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302155.491881:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789302155.492163:0:10505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10505:1876219121436928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302155.492199:0:10505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302155.492207:0:10505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302155.492214:0:10505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789302155.492219:0:10505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789302155.507478:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789302155.507519:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789302155.507531:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302155.507559:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302155.507571:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789302155.507573:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4adc31000 from 4 10000000:01000000:3.0:1789302155.507576:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789302155.507610:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302155.507617:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302155.507628:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302155.507652:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789302155.507717:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302155.507775:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4861596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302155.507987:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121437056 00000100:00100000:1.0:1789302155.507996:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121437056 00000100:00100000:1.0:1789302155.508036:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789302155.508045:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121437056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302155.508058:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302155.508070:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4addd2400/0x1ff82925bd3993a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39939b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.508095:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4addd2400/0x1ff82925bd3993a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39939b expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.508128:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4addd2400/0x1ff82925bd3993a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39939b expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.508136:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2400, rc 0) 00000100:00100000:1.0:1789302155.508172:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121437056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302155.508178:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789302155.509503:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302155.509524:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302155.509534:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302155.509600:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302155.509644:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302155.509682:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4861596c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302155.509700:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121437184 00000100:00100000:3.0:1789302155.509706:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121437184 00000100:00100000:3.0:1789302155.509740:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789302155.509747:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121437184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302155.509929:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121437184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302155.509937:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789302155.509967:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302155.509990:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302155.510023:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302155.510035:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4861596c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302155.510045:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121437312 00000100:00100000:3.0:1789302155.510048:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121437312 00000100:00100000:3.0:1789302155.510063:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789302155.510068:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121437312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302155.510476:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121437312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 406us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302155.510483:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789302155.510521:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302155.517526:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10509:1876219121437440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302155.517607:0:10509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302155.517647:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121437440 00000100:00100000:3.0:1789302155.517653:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121437440 00000100:00100000:3.0:1789302155.517689:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789302155.517698:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:10509:x1876219121437440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302155.517828:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:10509:x1876219121437440:12345-0@lo:502:llog_process_th.0 Request processed in 131us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302155.517836:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789302155.517891:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4861593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302155.517910:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10509:1876219121437440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302155.517943:0:10509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302155.517952:0:10509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302155.517955:0:10509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789302155.517961:0:10509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc4adc31000 00000020:00000080:3.0:1789302155.517963:0:10509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789302155.518033:0:10509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10509:1876219121437568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302155.518063:0:10509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302155.518074:0:10509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4861593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302155.519365:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121437568 00000100:00100000:1.0:1789302155.519376:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121437568 00000100:00100000:1.0:1789302155.519427:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789302155.519436:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+22:10509:x1876219121437568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302155.519552:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+22:10509:x1876219121437568:12345-0@lo:502:llog_process_th.0 Request processed in 116us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302155.519559:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789302155.522808:0:10509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10509:1876219121437568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302155.522863:0:10509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302155.522872:0:10509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302155.522874:0:10509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789302155.522879:0:10509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789302155.522990:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789302155.523018:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302155.523034:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.523046:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302155.523056:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302155.523058:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b511e800 from 4 10000000:01000000:1.0:1789302155.523061:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302155.523092:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.523100:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.523143:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302155.523164:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302155.523225:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302155.523257:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302155.523272:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121437696 00000100:00100000:1.0:1789302155.523277:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121437696 00000100:00100000:1.0:1789302155.523312:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789302155.523319:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121437696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302155.523331:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302155.523342:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4addd3a00/0x1ff82925bd3993b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3993a9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.524451:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4addd3a00/0x1ff82925bd3993b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3993a9 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.524478:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4addd3a00/0x1ff82925bd3993b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3993a9 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.524486:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3a00, rc 0) 00000100:00100000:1.0:1789302155.525195:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121437696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1872us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302155.525205:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789302155.528863:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302155.528893:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302155.528907:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302155.528998:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302155.529066:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302155.529142:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4861593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302155.529569:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121437824 00000100:00100000:1.0:1789302155.529578:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121437824 00000100:00100000:1.0:1789302155.529624:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789302155.529634:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121437824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302155.529759:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121437824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302155.529767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789302155.529807:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302155.529837:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302155.529877:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302155.529892:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302155.529905:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121437952 00000100:00100000:1.0:1789302155.529909:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121437952 00000100:00100000:1.0:1789302155.529928:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789302155.529933:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121437952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302155.530002:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121437952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302155.530008:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789302155.530052:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121437952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302155.539620:0:10510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10510:1876219121438080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302155.539799:0:10510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302155.539829:0:10510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0c9db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302155.539902:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121438080 00000100:00100000:1.0:1789302155.539910:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121438080 00000100:00100000:1.0:1789302155.539962:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789302155.539972:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:10510:x1876219121438080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302155.540083:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:10510:x1876219121438080:12345-0@lo:502:llog_process_th.0 Request processed in 113us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302155.540091:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789302155.544824:0:10510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10510:1876219121438080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302155.544868:0:10510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302155.544879:0:10510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302155.544881:0:10510:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789302155.544889:0:10510:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc4b511e800 00000020:00000080:0.0:1789302155.544892:0:10510:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789302155.544984:0:10510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10510:1876219121438208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302155.545054:0:10510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302155.545088:0:10510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302155.547526:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121438208 00000100:00100000:3.0:1789302155.547539:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121438208 00000100:00100000:3.0:1789302155.548535:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789302155.548549:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:10510:x1876219121438208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302155.548698:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:10510:x1876219121438208:12345-0@lo:502:llog_process_th.0 Request processed in 154us (3644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302155.548706:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789302155.550576:0:10510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10510:1876219121438208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302155.550616:0:10510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302155.550625:0:10510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302155.550627:0:10510:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789302155.550639:0:10510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789302155.550862:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789302155.550907:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302155.550953:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.550966:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302155.550977:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302155.550981:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b863d000 from 4 10000000:01000000:1.0:1789302155.550984:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302155.551017:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.551025:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.551034:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302155.551056:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121438336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302155.551170:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302155.551205:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302155.553042:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121438336 00000100:00100000:0.0:1789302155.553054:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121438336 00000100:00100000:0.0:1789302155.554060:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789302155.554073:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121438336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302155.554090:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302155.554132:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538fe00/0x1ff82925bd3993be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3993b7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302155.554159:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538fe00/0x1ff82925bd3993be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3993b7 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302155.554859:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538fe00/0x1ff82925bd3993be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3993b7 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302155.554869:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538fe00, rc 0) 00000100:00100000:0.0:1789302155.554939:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121438336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 868us (3769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302155.554947:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789302155.554976:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121438336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302155.554998:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302155.555257:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302155.555344:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121438464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302155.555379:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302155.555405:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302155.555420:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121438464 00000100:00100000:1.0:1789302155.555426:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121438464 00000100:00100000:1.0:1789302155.555464:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789302155.555473:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121438464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302155.555604:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121438464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302155.555612:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789302155.556031:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121438464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302155.556077:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121438592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302155.556161:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302155.556198:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc486159c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302155.556703:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121438592 00000100:00100000:0.0:1789302155.556710:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121438592 00000100:00100000:0.0:1789302155.556863:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789302155.556872:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121438592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302155.557495:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121438592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 624us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302155.557503:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789302155.557551:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121438592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302155.558316:0:10514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10514:1876219121438720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302155.559617:0:10514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302155.559679:0:10514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789302155.560775:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121438720 00000100:00100000:3.0:1789302155.560785:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121438720 00000100:00100000:3.0:1789302155.560845:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789302155.560857:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:10514:x1876219121438720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302155.561012:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:10514:x1876219121438720:12345-0@lo:502:llog_process_th.0 Request processed in 158us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302155.561021:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789302155.561090:0:10514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10514:1876219121438720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789302155.561155:0:10514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302155.561166:0:10514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302155.561169:0:10514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789302155.561178:0:10514:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc4b863d000 00000020:00000080:2.0:1789302155.561181:0:10514:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789302155.561272:0:10514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10514:1876219121438848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302155.561317:0:10514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302155.561367:0:10514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc38293c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789302155.564067:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121438848 00000100:00100000:0.0:1789302155.564085:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121438848 00000100:00100000:0.0:1789302155.564157:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789302155.564167:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:10514:x1876219121438848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302155.564307:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:10514:x1876219121438848:12345-0@lo:502:llog_process_th.0 Request processed in 141us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302155.564316:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789302155.567259:0:10514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:10514:1876219121438848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302155.567301:0:10514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302155.567309:0:10514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302155.567312:0:10514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789302155.567317:0:10514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789302155.567389:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789302155.567423:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302155.567433:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302155.567445:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302155.668343:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302155.860273:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121438976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302155.860339:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302155.860474:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121438976 00000100:00100000:1.0:1789302155.860483:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121438976 00000100:00100000:1.0:1789302155.860540:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789302155.860548:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121438976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302155.860571:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302155.860608:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121438976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302155.860626:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789302155.860639:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789302155.860668:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfc000 x1876219121438976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302155.860683:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121438976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302155.861213:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302155.861225:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121439104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302155.861259:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302155.861334:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121439104 00000100:00100000:2.0:1789302155.861339:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121439104 00000100:00100000:2.0:1789302155.861382:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789302155.861390:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121439104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789302155.861410:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302155.861452:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121439104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302155.861458:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789302155.861546:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302155.861734:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383416300 x1876219121439104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302155.861749:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121439104:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789302156.694206:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302157.396402:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121439232:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396498:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.396561:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121439744:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396591:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.396612:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121440256:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396634:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.396649:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121440768:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396666:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.396690:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789302157.396695:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121439360:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396718:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.396736:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121439872:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396755:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.396772:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121440384:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396793:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.396828:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121439488:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396852:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302157.396864:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121439232 00000100:00100000:0.0:1789302157.396869:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121440000:0@lo:400:kworker.0 00000100:00100000:3.0:1789302157.396874:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121439232 00000100:00100000:0.0:1789302157.396887:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.396903:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121440512:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396920:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302157.396930:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789302157.396936:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789302157.396940:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121439232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396941:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121439616:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396960:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.396969:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121440128:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.396986:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302157.397001:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121439232:12345-0@lo:400:kworker.0 Request processed in 63us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397008:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121440640:0@lo:400:kworker.0 00000100:00100000:3.0:1789302157.397015:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789302157.397026:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.397055:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121439744 00000100:00100000:0.0:1789302157.397059:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121439744 00000100:00100000:0.0:1789302157.397087:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121439488 00000100:00100000:0.0:1789302157.397104:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121439488 00000100:00100000:0.0:1789302157.397145:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789302157.397152:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121439744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397191:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121439744:12345-0@lo:400:kworker.0 Request processed in 39us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397197:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789302157.397211:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789302157.397216:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121439488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397249:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121439488:12345-0@lo:400:kworker.0 Request processed in 33us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397254:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789302157.397273:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121440256 00000100:00100000:0.0:1789302157.397276:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121440256 00000100:00100000:0.0:1789302157.397309:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121440768 00000100:00100000:0.0:1789302157.397312:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121440768 00000100:00100000:0.0:1789302157.397325:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121440128 00000100:00100000:0.0:1789302157.397327:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121440128 00000100:00100000:0.0:1789302157.397338:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121440640 00000100:00100000:0.0:1789302157.397340:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121440640 00000100:00100000:0.0:1789302157.397354:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302157.397360:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121440256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397390:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121440256:12345-0@lo:400:kworker.0 Request processed in 31us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397396:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302157.397415:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789302157.397421:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121440768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397461:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121440768:12345-0@lo:400:kworker.0 Request processed in 40us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397468:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789302157.397479:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789302157.397485:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121440128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397510:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121440128:12345-0@lo:400:kworker.0 Request processed in 25us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397514:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789302157.397523:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789302157.397529:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121440640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397553:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121440640:12345-0@lo:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397558:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789302157.397598:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121439360 00000100:00100000:0.0:1789302157.397602:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121439360 00000100:00100000:0.0:1789302157.397619:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121439872 00000100:00100000:0.0:1789302157.397622:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121439872 00000100:00100000:0.0:1789302157.397635:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121440384 00000100:00100000:0.0:1789302157.397638:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121440384 00000100:00100000:0.0:1789302157.397649:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121440000 00000100:00100000:0.0:1789302157.397651:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121440000 00000100:00100000:0.0:1789302157.397662:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121440512 00000100:00100000:0.0:1789302157.397664:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121440512 00000100:00100000:0.0:1789302157.397675:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121439616 00000100:00100000:0.0:1789302157.397678:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121439616 00000100:00100000:0.0:1789302157.397691:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789302157.397697:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121439360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397733:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121439360:12345-0@lo:400:kworker.0 Request processed in 36us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397739:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789302157.397751:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302157.397756:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121439872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397779:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121439872:12345-0@lo:400:kworker.0 Request processed in 24us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397786:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302157.397796:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789302157.397802:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121440384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397827:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121440384:12345-0@lo:400:kworker.0 Request processed in 25us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397833:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789302157.397843:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789302157.397848:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121440000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397873:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121440000:12345-0@lo:400:kworker.0 Request processed in 26us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397879:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789302157.397889:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789302157.397895:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121440512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397920:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121440512:12345-0@lo:400:kworker.0 Request processed in 26us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397926:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789302157.397935:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789302157.397940:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121439616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.397973:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121439616:12345-0@lo:400:kworker.0 Request processed in 32us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.397979:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789302157.398033:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302157.398038:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302157.398040:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302157.398043:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302157.398166:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121440896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302157.398200:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.398379:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121440896 00000100:00100000:0.0:1789302157.398385:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121440896 00000100:00100000:0.0:1789302157.398412:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789302157.398418:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121440896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789302157.398447:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789302157.398483:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121440896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.398489:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789302157.398531:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121440896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302157.398563:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121439616:0@lo:400:kworker.0 00010000:00080000:0.0:1789302157.398578:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f09f80 x1876219121440128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302157.398590:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121440128:0@lo:400:kworker.0 00010000:00080000:0.0:1789302157.398600:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383456d80 x1876219121440640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302157.398609:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121440640:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.398628:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121439488:0@lo:400:kworker.0 00010000:00080000:0.0:1789302157.398638:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f09c00 x1876219121440000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302157.398645:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121440000:0@lo:400:kworker.0 00010000:00080000:0.0:1789302157.398655:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bdbb4380 x1876219121440512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302157.398664:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121440512:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.398700:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121439360:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.398710:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121439872:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.398718:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121440384:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.398726:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121439232:0@lo:400:kworker.0 00000100:00100000:0.0:1789302157.398734:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121439744:0@lo:400:kworker.0 00010000:00080000:0.0:1789302157.398746:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f09880 x1876219121440256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302157.398754:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121440256:0@lo:400:kworker.0 00010000:00080000:0.0:1789302157.398766:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383454a80 x1876219121440768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302157.398774:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121440768:0@lo:400:kworker.0 00010000:00010000:2.0:1789302157.716376:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302157.912361:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302157.912396:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121441024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302157.912513:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.912601:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121441024 00000100:00100000:0.0:1789302157.912612:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121441024 00000100:00100000:0.0:1789302157.912673:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789302157.912684:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121441024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302157.912721:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302157.912793:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121441024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.912801:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789302157.912853:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383454a80 x1876219121441024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302157.912875:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121441024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302157.920694:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302157.920728:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121441152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302157.921143:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302157.921274:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121441152 00000100:00100000:0.0:1789302157.921284:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121441152 00000100:00100000:0.0:1789302157.921351:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789302157.921363:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121441152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302157.921394:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302157.921447:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121441152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302157.921455:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789302157.921498:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd803480 x1876219121441152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302157.921520:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121441152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302158.420346:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302158.420368:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121441280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302158.420600:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302158.420663:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121441280 00000100:00100000:1.0:1789302158.420669:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121441280 00000100:00100000:1.0:1789302158.420710:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789302158.420719:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121441280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789302158.420751:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789302158.420802:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121441280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302158.420809:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789302158.420858:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121441280:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789302158.741812:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302159.765534:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789302160.136627:0:10707:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1789302160.228402:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302160.228439:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101454080 00000100:00100000:0.0:1789302160.228456:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101454080 00000100:00100000:0.0:1789302160.228504:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 278 00000100:00100000:0.0:1789302160.228514:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2398:x1876219101454080:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302160.228575:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2398:x1876219101454080:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 63us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302160.228583:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 278 00000100:00100000:1.0:1789302160.233032:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302160.233231:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101454208 00000100:00100000:3.0:1789302160.233240:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101454208 00000100:00100000:3.0:1789302160.233330:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 79 00000100:00100000:3.0:1789302160.233340:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101454208:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302160.233406:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101454208:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 67us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302160.233413:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 79 00000100:00100000:3.0:1789302160.233460:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302160.233557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302160.233581:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302160.233599:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101454464 00000100:00100000:3.0:1789302160.233603:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101454464 00000100:00100000:3.0:1789302160.233630:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101454592 00000100:00100000:3.0:1789302160.233633:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101454592 00000100:00100000:3.0:1789302160.233654:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:3.0:1789302160.233660:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101454464:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302160.233691:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101454464:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302160.233697:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:3.0:1789302160.233708:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:3.0:1789302160.233725:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101454592:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302160.233749:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101454592:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302160.233761:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:3.0:1789302160.233779:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101454336 00000100:00100000:3.0:1789302160.233783:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101454336 00000100:00100000:3.0:1789302160.233807:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 80 00000100:00100000:3.0:1789302160.233812:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101454336:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302160.233838:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101454336:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302160.233844:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 80 00000100:00080000:2.0:1789302160.234099:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302160.234105:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302160.234107:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302160.234109:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789302160.790236:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302160.996358:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121441408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302160.996446:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302160.996630:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121441536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302160.996670:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302161.005637:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121441408 00000100:00100000:2.0:1789302161.005659:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121441408 00000100:00100000:2.0:1789302161.005740:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121441536 00000100:00100000:2.0:1789302161.005745:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121441536 00000100:00100000:2.0:1789302161.005768:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302161.005780:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121441408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789302161.005821:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302161.005931:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121441408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (9484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302161.005939:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302161.005960:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789302161.005967:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121441536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302161.005978:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302161.006009:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121441536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (9339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302161.006015:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789302161.006195:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383414e00 x1876219121441408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302161.006220:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121441408:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789302161.006265:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383417480 x1876219121441536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302161.006278:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121441536:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789302161.006725:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789302161.813210:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302162.517474:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302162.517506:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121441664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302162.517596:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302162.527848:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121442048:0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.527949:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302162.527996:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121442560:0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.528023:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302162.528063:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121443072:0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.528087:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302162.528109:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789302162.528132:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121442176:0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.528160:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302162.528184:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121442688:0@lo:400:kworker.0 00000100:00100000:0.0:1789302162.528576:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121441792:0@lo:400:kworker.0 00000100:00100000:0.0:1789302162.528691:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302162.528724:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121442304:0@lo:400:kworker.0 00000100:00100000:0.0:1789302162.528752:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302162.528772:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121442816:0@lo:400:kworker.0 00000100:00100000:0.0:1789302162.528794:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302162.528818:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789302162.528825:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121441920:0@lo:400:kworker.0 00000100:00100000:0.0:1789302162.528846:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302162.528864:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121442432:0@lo:400:kworker.0 00000100:00100000:0.0:1789302162.528884:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302162.528904:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121442944:0@lo:400:kworker.0 00000100:00100000:0.0:1789302162.528926:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302162.528971:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121441792 00000100:00100000:0.0:1789302162.528981:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121441792 00000100:00100000:0.0:1789302162.529043:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789302162.529064:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121441792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302162.529147:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121441792:12345-0@lo:400:kworker.0 Request processed in 94us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302162.529175:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789302162.529780:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121442176 00000100:00100000:1.0:1789302162.529787:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121442176 00000100:00100000:1.0:1789302162.529815:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121442304 00000100:00100000:1.0:1789302162.529818:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121442304 00000100:00100000:1.0:1789302162.529848:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121442816 00000100:00100000:1.0:1789302162.529850:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121442816 00000100:00100000:1.0:1789302162.529861:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121441920 00000100:00100000:1.0:1789302162.529863:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121441920 00000100:00100000:1.0:1789302162.529874:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121442432 00000100:00100000:1.0:1789302162.529876:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121442432 00000100:00100000:1.0:1789302162.529890:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121442944 00000100:00100000:1.0:1789302162.529893:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121442944 00000100:00100000:1.0:1789302162.529908:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789302162.529916:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121442176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302162.529960:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121442176:12345-0@lo:400:kworker.0 Request processed in 45us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302162.529966:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789302162.529995:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789302162.530002:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121442304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302162.530029:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121442304:12345-0@lo:400:kworker.0 Request processed in 28us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302162.530045:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789302162.530076:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789302162.530082:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121442816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302162.530127:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121442816:12345-0@lo:400:kworker.0 Request processed in 31us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302162.530133:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789302162.530145:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789302162.530151:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121441920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302162.530179:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121441920:12345-0@lo:400:kworker.0 Request processed in 28us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302162.530184:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789302162.531823:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302162.531877:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121443200:0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.531906:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302162.531959:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121442176:0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.532009:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121441664 00000100:00100000:2.0:1789302162.532016:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121441664 00000100:00100000:2.0:1789302162.532076:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121442048 00000100:00100000:2.0:1789302162.532079:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121442048 00000100:00100000:2.0:1789302162.532098:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789302162.532107:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121441664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302162.532162:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789302162.533444:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789302162.533469:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121442432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302162.533535:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121442432:12345-0@lo:400:kworker.0 Request processed in 79us (4648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302162.533543:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789302162.533577:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789302162.533584:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121442944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302162.533615:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121442944:12345-0@lo:400:kworker.0 Request processed in 31us (4689us total) trans 0 rc 0/0 00000100:00080000:1.0:1789302162.533769:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789302162.533776:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302162.533965:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121441920:0@lo:400:kworker.0 00010000:00080000:1.0:1789302162.533983:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfca80 x1876219121442432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302162.533995:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121442432:0@lo:400:kworker.0 00010000:00080000:1.0:1789302162.534006:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfea00 x1876219121442944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302162.534015:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121442944:0@lo:400:kworker.0 00000100:00100000:1.0:1789302162.534027:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121441792:0@lo:400:kworker.0 00000100:00100000:1.0:1789302162.534039:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121442304:0@lo:400:kworker.0 00000100:00100000:1.0:1789302162.534052:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121442816:0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.535934:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121441664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3816us (18326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302162.535962:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789302162.536004:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789302162.536019:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121442048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.536091:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121442048:12345-0@lo:400:kworker.0 Request processed in 80us (8144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302162.536099:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789302162.536165:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121442560 00000100:00100000:2.0:1789302162.536175:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121442560 00000100:00100000:0.0:1789302162.536359:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789302162.539594:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121443072 00000100:00100000:2.0:1789302162.539609:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121443072 00000100:00100000:2.0:1789302162.539632:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121442688 00000100:00100000:2.0:1789302162.539635:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121442688 00000100:00100000:2.0:1789302162.539652:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121443200 00000100:00100000:2.0:1789302162.539655:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121443200 00000100:00100000:2.0:1789302162.539676:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302162.539687:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121442560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.539790:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121442560:12345-0@lo:400:kworker.0 Request processed in 105us (11765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302162.539798:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302162.539816:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789302162.539823:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121443072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.539853:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121443072:12345-0@lo:400:kworker.0 Request processed in 31us (11765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302162.539858:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789302162.539868:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302162.539874:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121442688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.539923:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121442688:12345-0@lo:400:kworker.0 Request processed in 49us (8109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302162.539929:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302162.540103:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789302162.540135:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121443200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.540166:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121443200:12345-0@lo:400:kworker.0 Request processed in 57us (8260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302162.540172:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789302162.540351:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302162.540357:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302162.548490:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfdc00 x1876219121442688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302162.548512:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121442688:0@lo:400:kworker.0 00010000:00080000:2.0:1789302162.548529:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfd500 x1876219121443200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302162.548538:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121443200:0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.548550:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121442048:0@lo:400:kworker.0 00010000:00080000:2.0:1789302162.548562:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfed80 x1876219121442560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302162.548570:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121442560:0@lo:400:kworker.0 00010000:00080000:2.0:1789302162.548581:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bffb80 x1876219121443072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302162.548588:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121443072:0@lo:400:kworker.0 00000100:00100000:2.0:1789302162.548611:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121441664:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789302162.837749:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302163.035465:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121443456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302163.035549:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302163.035634:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302163.035641:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121443328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302163.035667:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302163.035840:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121443456 00000100:00100000:0.0:1789302163.035849:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121443456 00000100:00100000:0.0:1789302163.035898:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121443328 00000100:00100000:0.0:1789302163.035902:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121443328 00000100:00100000:0.0:1789302163.035919:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789302163.035929:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121443456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302163.035962:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302163.036020:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121443456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302163.036027:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789302163.036045:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789302163.036063:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121443328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302163.036073:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302163.036095:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121443328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302163.036162:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789302163.038261:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383415f80 x1876219121443328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302163.038294:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121443328:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789302163.038310:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfce00 x1876219121443456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302163.038322:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121443456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302163.540680:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302163.540715:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121443584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789302163.540810:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302163.540890:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121443584 00000100:00100000:0.0:1789302163.540900:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121443584 00000100:00100000:0.0:1789302163.540956:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789302163.540967:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121443584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302163.541008:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789302163.541361:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121443584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 394us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302163.541370:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789302163.541892:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121443584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789302163.861607:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302164.887732:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302165.347456:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302165.347496:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302165.347525:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302165.347545:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302165.347565:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302165.348618:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101455104 00000100:00100000:2.0:1789302165.348630:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101455104 00000100:00100000:2.0:1789302165.348686:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101455232 00000100:00100000:2.0:1789302165.348689:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101455232 00000100:00100000:2.0:1789302165.348713:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:2.0:1789302165.348725:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2395:x1876219101455104:12345-192.168.203.9@tcp:9:kworker.0 00000020:00000080:2.0:1789302165.348761:0:8445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3992d0 00000100:00080000:2.0:1789302165.348771:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7ef4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789302165.348813:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789302165.348974:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+2:2395:x1876219101455104:12345-192.168.203.9@tcp:9:kworker.0 Request processed in 252us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302165.348982:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:2.0:1789302165.348997:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00100000:2.0:1789302165.349004:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2395:x1876219101455232:12345-192.168.203.9@tcp:9:kworker.0 00000020:00000080:2.0:1789302165.349018:0:8445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3992d7 00000100:00080000:2.0:1789302165.349024:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cc38380e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789302165.349058:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789302165.349151:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+2:2395:x1876219101455232:12345-192.168.203.9@tcp:9:kworker.0 Request processed in 146us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302165.349158:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00080000:2.0:1789302165.349179:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302165.349183:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789302165.349245:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302165.349349:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302165.350021:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101454720 00000100:00100000:0.0:1789302165.350028:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101454720 00000100:00100000:0.0:1789302165.350078:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 280 00000100:00100000:0.0:1789302165.350086:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2397:x1876219101454720:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302165.350147:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2397:x1876219101454720:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 62us (2701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302165.350154:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 280 00000100:00100000:3.0:1789302165.353161:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101454976 00000100:00100000:3.0:1789302165.353176:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101454976 00000100:00100000:3.0:1789302165.353234:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101454848 00000100:00100000:3.0:1789302165.353239:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101454848 00000100:00100000:3.0:1789302165.353271:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 87 00000100:00100000:3.0:1789302165.353280:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101454976:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302165.353354:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101454976:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 74us (5856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302165.353372:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 87 00000100:00100000:3.0:1789302165.353392:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 88 00000100:00100000:3.0:1789302165.353399:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2397:x1876219101454848:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302165.353426:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2397:x1876219101454848:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 27us (5901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302165.353432:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 88 00000100:00080000:2.0:1789302165.353798:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302165.353803:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789302165.909757:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302166.101102:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121443712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302166.101199:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302166.101267:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121443712 00000100:00100000:1.0:1789302166.101274:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121443712 00000100:00100000:1.0:1789302166.101502:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789302166.101514:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121443712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789302166.101543:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302166.101590:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121443712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302166.101597:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789302166.101899:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfce00 x1876219121443712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302166.101918:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121443712:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789302166.102149:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302166.102167:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302166.102177:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121443840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302166.102211:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302166.102237:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121443840 00000100:00100000:2.0:1789302166.102241:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121443840 00000100:00100000:2.0:1789302166.102271:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789302166.102278:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121443840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302166.102288:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302166.102329:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121443840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302166.102345:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789302166.102359:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302166.102387:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383414700 x1876219121443840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302166.102400:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121443840:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789302166.429539:0:10951:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing yml_node 00010000:00010000:3.0:1789302166.932323:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302167.636900:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302167.636921:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121443968:0@lo:400:kworker.0 00000100:00100000:0.0:1789302167.636988:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302167.637066:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121443968 00000100:00100000:0.0:1789302167.637080:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121443968 00000100:00100000:0.0:1789302167.637138:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789302167.637146:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121443968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302167.637301:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121443968:12345-0@lo:400:kworker.0 Request processed in 155us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302167.637308:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789302167.637356:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121443968:0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.639316:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121444096:0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.639378:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302167.640576:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121444224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302167.640622:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302167.640683:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302167.640691:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121444480:0@lo:400:kworker.0 00000100:00100000:3.0:1789302167.640757:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121444224 00000100:00100000:3.0:1789302167.640767:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121444224 00000100:00100000:3.0:1789302167.640815:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789302167.640823:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121444224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789302167.640939:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302167.640986:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121444224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302167.640993:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789302167.641104:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121444096 00000100:00100000:2.0:1789302167.641242:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121444096 00000100:00100000:0.0:1789302167.641267:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302167.641329:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121444352:0@lo:400:kworker.0 00000100:00100000:0.0:1789302167.641354:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302167.641382:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121444992:0@lo:400:kworker.0 00000100:00100000:2.0:1789302167.641403:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121444480 00000100:00100000:0.0:1789302167.641404:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302167.641407:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121444480 00000100:00100000:2.0:1789302167.641433:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789302167.641440:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121444096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302167.641531:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121445504:0@lo:400:kworker.0 00000100:00100000:3.0:1789302167.641570:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789302167.641579:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121444480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.641691:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121444608:0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.641726:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302167.641741:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121445120:0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.641756:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302167.641764:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789302167.641768:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121444736:0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.641782:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302167.641789:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121445248:0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.641802:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302167.641817:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121444608 00000100:00100000:1.0:1789302167.641820:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121444608 00000100:00100000:1.0:1789302167.641842:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121445120 00000100:00100000:1.0:1789302167.641844:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121445120 00000100:00100000:1.0:1789302167.641854:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121444736 00000100:00100000:1.0:1789302167.641856:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121444736 00000100:00100000:1.0:1789302167.641877:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121445248 00000100:00100000:1.0:1789302167.641880:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121445248 00000100:00100000:1.0:1789302167.641894:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789302167.641900:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121444608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.641939:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121444608:12345-0@lo:400:kworker.0 Request processed in 39us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302167.641959:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789302167.641974:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789302167.641980:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121445120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.642028:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121445120:12345-0@lo:400:kworker.0 Request processed in 40us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302167.642033:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789302167.642046:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789302167.642052:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121444736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.642083:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121444736:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302167.642087:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789302167.642097:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789302167.642102:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121445248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.642146:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121445248:12345-0@lo:400:kworker.0 Request processed in 44us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302167.642152:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1789302167.642192:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383416300 x1876219121444736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302167.642206:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121444736:0@lo:400:kworker.0 00010000:00080000:1.0:1789302167.642218:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485dd3480 x1876219121445248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302167.642227:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121445248:0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.642235:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121444608:0@lo:400:kworker.0 00000100:00100000:1.0:1789302167.642252:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121445120:0@lo:400:kworker.0 00000100:00100000:3.0:1789302167.644558:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121444480:12345-0@lo:400:kworker.0 Request processed in 2974us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302167.644570:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789302167.645040:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302167.645085:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121444480:0@lo:400:kworker.0 00000100:00100000:0.0:1789302167.645106:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789302167.645128:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121444864:0@lo:400:kworker.0 00000100:00100000:0.0:1789302167.645154:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302167.645172:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121445376:0@lo:400:kworker.0 00000100:00100000:0.0:1789302167.645204:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302167.645240:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121444352 00000100:00100000:0.0:1789302167.645247:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121444352 00000100:00100000:0.0:1789302167.645278:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302167.645284:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121444352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302167.645328:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121444352:12345-0@lo:400:kworker.0 Request processed in 44us (3973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302167.645334:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302167.645383:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121444352:0@lo:400:kworker.0 00000100:00100000:2.0:1789302167.648468:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121444096:12345-0@lo:400:kworker.0 Request processed in 7019us (9080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302167.648482:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789302167.648992:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121444096:0@lo:400:kworker.0 00000100:00100000:3.0:1789302167.652791:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121444224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302167.652909:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121444992 00000100:00100000:2.0:1789302167.652917:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121444992 00000100:00100000:0.0:1789302167.652976:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121445504 00000100:00100000:0.0:1789302167.652981:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121445504 00000100:00100000:0.0:1789302167.653075:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121444864 00000100:00100000:0.0:1789302167.653080:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121444864 00000100:00100000:0.0:1789302167.653093:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121445376 00000100:00100000:0.0:1789302167.653096:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121445376 00000100:00100000:0.0:1789302167.653244:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789302167.653255:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121445504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302167.653482:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121445504:12345-0@lo:400:kworker.0 Request processed in 229us (8442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302167.653490:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789302167.653505:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789302167.653512:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121444864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302167.653541:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121444864:12345-0@lo:400:kworker.0 Request processed in 30us (8387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302167.653547:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789302167.653558:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789302167.653563:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121445376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302167.653592:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121445376:12345-0@lo:400:kworker.0 Request processed in 28us (8387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302167.653605:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789302167.653621:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302167.653626:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302167.653628:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302167.654063:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789302167.654072:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121444992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302167.654135:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121444992:12345-0@lo:400:kworker.0 Request processed in 65us (12730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302167.654142:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789302167.655682:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd968000 x1876219121445504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302167.655711:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121445504:0@lo:400:kworker.0 00010000:00080000:3.0:1789302167.655740:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383415180 x1876219121444864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302167.655748:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121444864:0@lo:400:kworker.0 00010000:00080000:3.0:1789302167.655759:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc382917480 x1876219121445376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302167.655766:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121445376:0@lo:400:kworker.0 00010000:00080000:3.0:1789302167.655777:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383414700 x1876219121444992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302167.655784:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121444992:0@lo:400:kworker.0 00010000:00010000:2.0:1789302167.959518:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302168.150156:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121445632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302168.150343:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302168.150429:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121445632 00000100:00100000:3.0:1789302168.150437:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121445632 00000100:00100000:3.0:1789302168.150484:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789302168.150493:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121445632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302168.150521:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302168.150681:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121445632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302168.150688:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789302168.150729:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f08700 x1876219121445632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302168.150760:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121445632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302168.151822:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd96b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121445760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302168.151874:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302168.152155:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121445760 00000100:00100000:2.0:1789302168.152222:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121445760 00000100:00100000:2.0:1789302168.152258:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789302168.152267:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121445760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789302168.152284:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302168.152321:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121445760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302168.152327:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789302168.152395:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd96b800 x1876219121445760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302168.152411:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd96b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121445760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302168.661034:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121445888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302168.661103:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302168.661271:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121445888 00000100:00100000:2.0:1789302168.661279:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121445888 00000100:00100000:2.0:1789302168.661327:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789302168.661337:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121445888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302168.661369:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789302168.661406:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121445888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302168.661413:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789302168.661488:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121445888:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789302168.983781:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302170.006603:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302170.463716:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302170.463764:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302170.463801:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302170.463891:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101455616 00000100:00100000:0.0:1789302170.463900:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101455616 00000100:00100000:0.0:1789302170.463973:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101455488 00000100:00100000:0.0:1789302170.463976:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101455488 00000100:00100000:0.0:1789302170.464016:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 95 00000100:00100000:0.0:1789302170.464027:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101455616:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302170.464095:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101455616:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 70us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302170.464103:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 95 00000100:00100000:0.0:1789302170.464166:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 96 00000100:00100000:0.0:1789302170.464173:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101455488:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302170.464199:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101455488:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 27us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302170.464205:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 96 00000100:00080000:2.0:1789302170.464590:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302170.464594:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302170.468549:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101455360 00000100:00100000:3.0:1789302170.468563:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101455360 00000100:00100000:3.0:1789302170.468629:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 282 00000100:00100000:3.0:1789302170.468639:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2399:x1876219101455360:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302170.468719:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2399:x1876219101455360:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 81us (5011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302170.468725:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 282 00000001:00100000:1.0:1789302170.716279:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:1.0:1789302170.716287:0:9525:0:(genops.c:885:class_export_put()) final put ffff8cc38380c800/c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:3.0:1789302170.717400:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc38380c800/c76ee310-c3b4-4286-aaea-77936c269d98 for lustre-OST0001 00000020:00000080:3.0:1789302170.717451:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc38380e800 for lustre-OST0001 00000001:00100000:1.0:1789302170.726014:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:1.0:1789302170.726023:0:8439:0:(genops.c:885:class_export_put()) final put ffff8cc4b7ef7000/c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:2.0:1789302170.726104:0:486:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b7ef7000/c76ee310-c3b4-4286-aaea-77936c269d98 for lustre-OST0000 00000020:00000080:2.0:1789302170.726184:0:486:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b7ef4800 for lustre-OST0000 00010000:00010000:2.0:1789302171.029079:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302171.220365:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302171.220387:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121446016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302171.220463:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302171.222972:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121446016 00000100:00100000:2.0:1789302171.222985:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121446016 00000100:00100000:2.0:1789302171.223071:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789302171.223086:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121446016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789302171.223134:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302171.223204:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121446016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302171.223211:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789302171.223326:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302171.223362:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfed80 x1876219121446016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302171.223383:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121446016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302171.226364:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302171.226387:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121446144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302171.226450:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302171.226573:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121446144 00000100:00100000:2.0:1789302171.226582:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121446144 00000100:00100000:2.0:1789302171.226652:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789302171.226662:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121446144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302171.226682:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302171.226725:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121446144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302171.226732:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789302171.226837:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302171.226899:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfc380 x1876219121446144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302171.226928:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121446144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789302172.052334:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302172.756424:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121446272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302172.756489:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302172.756917:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121446272 00000100:00100000:2.0:1789302172.756925:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121446272 00000100:00100000:2.0:1789302172.756974:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789302172.756992:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121446272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302172.757025:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789302172.757076:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121446272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302172.757083:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789302172.757265:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121446528:0@lo:400:kworker.0 00000100:00100000:3.0:1789302172.757295:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302172.757314:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121447040:0@lo:400:kworker.0 00000100:00100000:3.0:1789302172.757332:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302172.757343:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121447552:0@lo:400:kworker.0 00000100:00100000:3.0:1789302172.757359:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302172.757372:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789302172.757377:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121446400:0@lo:400:kworker.0 00000100:00100000:3.0:1789302172.757398:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302172.757415:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121446912:0@lo:400:kworker.0 00000100:00100000:3.0:1789302172.757430:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302172.757443:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121447424:0@lo:400:kworker.0 00000100:00100000:3.0:1789302172.757458:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302172.757478:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121446528 00000100:00100000:3.0:1789302172.757482:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121446528 00000100:00100000:3.0:1789302172.757499:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121447040 00000100:00100000:3.0:1789302172.757502:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121447040 00000100:00100000:3.0:1789302172.757517:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121447552 00000100:00100000:3.0:1789302172.757519:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121447552 00000100:00100000:3.0:1789302172.757529:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121446912 00000100:00100000:3.0:1789302172.757531:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121446912 00000100:00100000:3.0:1789302172.757540:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121447424 00000100:00100000:3.0:1789302172.757542:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121447424 00000100:00100000:3.0:1789302172.757552:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789302172.757557:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121446528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302172.757610:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121446528:12345-0@lo:400:kworker.0 Request processed in 52us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302172.757616:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789302172.757630:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789302172.757636:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121447040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302172.757660:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121447040:12345-0@lo:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302172.757892:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789302172.757992:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121446400 00000100:00100000:0.0:1789302172.757996:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121446400 00000100:00100000:0.0:1789302172.758023:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789302172.758029:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121446400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302172.758058:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121446400:12345-0@lo:400:kworker.0 Request processed in 29us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302172.758063:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789302172.764500:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789302172.764934:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121447552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.765051:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121447552:12345-0@lo:400:kworker.0 Request processed in 135us (7690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302172.765059:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789302172.765092:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789302172.765101:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121446912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.765152:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121446912:12345-0@lo:400:kworker.0 Request processed in 54us (7720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302172.765158:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789302172.765171:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789302172.765179:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121447424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.765207:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121447424:12345-0@lo:400:kworker.0 Request processed in 30us (7747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302172.765213:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789302172.765283:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121446400:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.765298:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121446912:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.765309:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121447424:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.765320:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121446528:0@lo:400:kworker.0 00010000:00080000:2.0:1789302172.765333:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eff100 x1876219121447040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302172.765344:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121447040:0@lo:400:kworker.0 00010000:00080000:2.0:1789302172.765355:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efce00 x1876219121447552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302172.765376:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121447552:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.765439:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121446656:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.765478:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302172.765506:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121447168:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.765530:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302172.766576:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121447680:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.766607:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302172.766626:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789302172.766631:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121446784:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.766694:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302172.766707:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121447296:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.766719:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302172.766728:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121447808:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.766739:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302172.766761:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121446656 00000100:00100000:2.0:1789302172.766766:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121446656 00000100:00100000:2.0:1789302172.766804:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789302172.766812:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121446656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.766910:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121446656:12345-0@lo:400:kworker.0 Request processed in 99us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302172.766917:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789302172.766937:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121447168 00000100:00100000:2.0:1789302172.766942:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121447168 00000100:00100000:2.0:1789302172.766960:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121447680 00000100:00100000:2.0:1789302172.766972:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121447680 00000100:00100000:2.0:1789302172.767024:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121447296 00000100:00100000:2.0:1789302172.767028:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121447296 00000100:00100000:2.0:1789302172.767042:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121447808 00000100:00100000:2.0:1789302172.767044:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121447808 00000100:00100000:2.0:1789302172.767059:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789302172.767065:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121447168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.767096:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121447168:12345-0@lo:400:kworker.0 Request processed in 32us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302172.767102:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789302172.767131:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789302172.767137:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121447680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.767161:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121447680:12345-0@lo:400:kworker.0 Request processed in 25us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302172.767167:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789302172.767177:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789302172.767182:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121447296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.767201:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121447296:12345-0@lo:400:kworker.0 Request processed in 20us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302172.767215:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789302172.767224:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789302172.767230:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121447808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.767250:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121447808:12345-0@lo:400:kworker.0 Request processed in 22us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302172.767256:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789302172.767302:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121446272:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1789302172.767344:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efca80 x1876219121447296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302172.767356:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121447296:0@lo:400:kworker.0 00010000:00080000:2.0:1789302172.767365:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7effb80 x1876219121447808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302172.767373:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121447808:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.767382:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121446656:0@lo:400:kworker.0 00010000:00080000:2.0:1789302172.767391:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efed80 x1876219121447168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302172.767398:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121447168:0@lo:400:kworker.0 00010000:00080000:2.0:1789302172.767407:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efea00 x1876219121447680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302172.767414:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121447680:0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.767438:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121446784 00000100:00100000:2.0:1789302172.767442:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121446784 00000100:00100000:2.0:1789302172.767469:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789302172.767476:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121446784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302172.767512:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121446784:12345-0@lo:400:kworker.0 Request processed in 37us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302172.767518:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789302172.767545:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121446784:0@lo:400:kworker.0 00000100:00080000:2.0:1789302172.767662:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302172.767674:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302172.767677:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789302173.077868:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302173.269524:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121448064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302173.269590:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302173.269649:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302173.269656:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121447936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302173.269783:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121448064 00000100:00100000:3.0:1789302173.269791:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121448064 00000100:00100000:3.0:1789302173.269837:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789302173.269847:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121448064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789302173.269874:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302173.269925:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121448064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302173.269933:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789302173.270049:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789302173.270088:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d50e00 x1876219121448064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302173.270106:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121448064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302173.270256:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121447936 00000100:00100000:3.0:1789302173.270260:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121447936 00000100:00100000:3.0:1789302173.270282:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789302173.270289:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121447936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302173.270299:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302173.270339:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121447936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302173.270345:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789302173.270577:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efc000 x1876219121447936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302173.270590:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121447936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302173.780291:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302173.780312:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121448192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302173.780381:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302173.780507:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121448192 00000100:00100000:3.0:1789302173.780529:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121448192 00000100:00100000:3.0:1789302173.780584:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789302173.780596:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121448192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789302173.780631:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789302173.780681:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121448192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302173.780688:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789302173.781241:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121448192:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1789302173.881725:0:11135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:2.0:1789302174.100291:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302175.124976:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302175.584419:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302175.584595:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302175.584683:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302175.585560:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101455744 00000100:00100000:0.0:1789302175.585572:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101455744 00000100:00100000:0.0:1789302175.585714:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 284 00000100:00100000:0.0:1789302175.585725:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2398:x1876219101455744:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302175.585793:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2398:x1876219101455744:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 70us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302175.585800:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 284 00000100:00100000:2.0:1789302175.586425:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101456000 00000100:00100000:2.0:1789302175.586431:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101456000 00000100:00100000:2.0:1789302175.586490:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101455872 00000100:00100000:2.0:1789302175.586494:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101455872 00000100:00100000:2.0:1789302175.586519:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 103 00000100:00100000:2.0:1789302175.586531:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101456000:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302175.586575:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 104 00000100:00100000:2.0:1789302175.586581:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101456000:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 50us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302175.586590:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101455872:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302175.586594:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 103 00000100:00100000:0.0:1789302175.586628:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101455872:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 42us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302175.586635:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 104 00000100:00080000:1.0:1789302175.586842:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302175.586846:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789302176.149589:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302176.346581:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302176.346603:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121448320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302176.346681:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302176.346740:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121448320 00000100:00100000:1.0:1789302176.346747:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121448320 00000100:00100000:1.0:1789302176.346800:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789302176.346809:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121448320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789302176.346834:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302176.346892:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121448320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302176.346898:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789302176.346918:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789302176.346956:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfe680 x1876219121448320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302176.347189:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121448320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302176.351589:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302176.351610:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121448448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302176.351772:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302176.351878:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121448448 00000100:00100000:0.0:1789302176.351887:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121448448 00000100:00100000:0.0:1789302176.351956:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789302176.351985:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121448448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302176.352008:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302176.352051:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121448448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302176.352057:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789302176.352220:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789302176.352245:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bfe680 x1876219121448448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302176.352262:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121448448:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789302176.704903:0:11232:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:2.0:1789302177.180613:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302177.876437:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302177.876460:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121448576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302177.876524:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302177.876587:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121448576 00000100:00100000:3.0:1789302177.876594:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121448576 00000100:00100000:3.0:1789302177.876852:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789302177.876862:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121448576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789302177.876892:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302177.876957:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121448576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302177.876965:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789302177.877009:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121448576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302177.878306:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121449088:0@lo:400:kworker.0 00000100:00100000:1.0:1789302177.878353:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302177.878392:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121449600:0@lo:400:kworker.0 00000100:00100000:1.0:1789302177.878415:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302177.878440:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121450112:0@lo:400:kworker.0 00000100:00100000:1.0:1789302177.878461:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302177.878482:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789302177.878488:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121448960:0@lo:400:kworker.0 00000100:00100000:1.0:1789302177.878510:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302177.878526:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121449472:0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.878545:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121448704:0@lo:400:kworker.0 00000100:00100000:1.0:1789302177.878545:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302177.878565:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121449984:0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.878576:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302177.878581:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302177.878598:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121449216:0@lo:400:kworker.0 00000100:00100000:1.0:1789302177.878616:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121449088 00000100:00100000:1.0:1789302177.878623:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121449088 00000100:00100000:2.0:1789302177.878629:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302177.878646:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121449728:0@lo:400:kworker.0 00000100:00100000:1.0:1789302177.878658:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121449216 00000100:00100000:1.0:1789302177.878661:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121449216 00000100:00100000:2.0:1789302177.878666:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302177.878682:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789302177.878683:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121449728 00000100:00100000:1.0:1789302177.878686:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121449728 00000100:00100000:2.0:1789302177.878687:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121448832:0@lo:400:kworker.0 00000100:00100000:1.0:1789302177.878701:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789302177.878706:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302177.878708:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121449088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.878714:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121449344:0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.878732:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302177.878741:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121449856:0@lo:400:kworker.0 00000100:00100000:3.0:1789302177.878844:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121448832 00000100:00100000:3.0:1789302177.878849:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121448832 00000100:00100000:3.0:1789302177.878867:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121449344 00000100:00100000:3.0:1789302177.878870:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121449344 00000100:00100000:3.0:1789302177.878884:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789302177.878890:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121449216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302177.878994:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121449088:12345-0@lo:400:kworker.0 Request processed in 283us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302177.879002:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789302177.879018:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789302177.879024:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121449728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302177.881175:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121449600 00000100:00100000:0.0:1789302177.881188:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121449600 00000100:00100000:0.0:1789302177.881232:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121450112 00000100:00100000:0.0:1789302177.881235:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121450112 00000100:00100000:0.0:1789302177.881252:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121449472 00000100:00100000:0.0:1789302177.881256:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121449472 00000100:00100000:0.0:1789302177.881266:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121449984 00000100:00100000:0.0:1789302177.881269:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121449984 00000100:00100000:0.0:1789302177.881288:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789302177.881297:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121449600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.884832:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302177.884892:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121448704 00000100:00100000:2.0:1789302177.884901:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121448704 00000100:00100000:2.0:1789302177.884991:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789302177.885002:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121448704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.885061:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121448704:12345-0@lo:400:kworker.0 Request processed in 62us (6483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302177.885069:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789302177.885103:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121449856 00000100:00100000:2.0:1789302177.885107:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121449856 00000100:00100000:2.0:1789302177.885151:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789302177.885158:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121448832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.885201:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121448832:12345-0@lo:400:kworker.0 Request processed in 43us (6493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302177.885221:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789302177.885238:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789302177.885254:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121449344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.885289:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121449344:12345-0@lo:400:kworker.0 Request processed in 44us (6555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302177.885295:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789302177.885307:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789302177.885314:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121449856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.885357:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121449856:12345-0@lo:400:kworker.0 Request processed in 28us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302177.885363:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789302177.885421:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121448832:0@lo:400:kworker.0 00010000:00080000:2.0:1789302177.885436:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383415f80 x1876219121449344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302177.885447:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121449344:0@lo:400:kworker.0 00010000:00080000:2.0:1789302177.885456:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383416300 x1876219121449856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302177.885465:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121449856:0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.885475:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121448704:0@lo:400:kworker.0 00000100:00100000:3.0:1789302177.887023:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121449216:12345-0@lo:400:kworker.0 Request processed in 8117us (8377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302177.887045:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789302177.887049:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121449216:0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.889056:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789302177.889078:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121450112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.889185:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121450112:12345-0@lo:400:kworker.0 Request processed in 118us (10722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302177.889193:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789302177.889215:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789302177.889223:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121449472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.889253:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121449472:12345-0@lo:400:kworker.0 Request processed in 32us (10707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302177.889259:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789302177.889272:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789302177.889280:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121449984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.889309:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121449984:12345-0@lo:400:kworker.0 Request processed in 31us (10726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302177.889314:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789302177.889337:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121448960 00000100:00100000:2.0:1789302177.889357:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121448960 00000100:00100000:2.0:1789302177.889398:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789302177.889404:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121448960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302177.889439:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121448960:12345-0@lo:400:kworker.0 Request processed in 35us (10928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302177.889444:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1789302177.892000:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789302177.892008:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789302177.892011:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302177.893316:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121448960:0@lo:400:kworker.0 00010000:00080000:3.0:1789302177.893333:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383417480 x1876219121449472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302177.893344:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121449472:0@lo:400:kworker.0 00010000:00080000:3.0:1789302177.893355:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e61880 x1876219121449984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302177.895144:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121449984:0@lo:400:kworker.0 00000100:00100000:3.0:1789302177.895175:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121449088:0@lo:400:kworker.0 00010000:00080000:3.0:1789302177.895188:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e61c00 x1876219121450112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302177.895345:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121450112:0@lo:400:kworker.0 00000100:00100000:0.0:1789302177.895704:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121449600:12345-0@lo:400:kworker.0 Request processed in 14405us (17285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302177.895714:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789302177.895865:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383414e00 x1876219121449600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302177.895874:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121449600:0@lo:400:kworker.0 00000100:00100000:0.0:1789302177.896367:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121449728:12345-0@lo:400:kworker.0 Request processed in 17341us (17697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302177.896377:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789302177.896444:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121449728:0@lo:400:kworker.0 00010000:00010000:2.0:1789302178.196494:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302178.390347:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121450240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302178.390420:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302178.390683:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121450240 00000100:00100000:2.0:1789302178.390692:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121450240 00000100:00100000:2.0:1789302178.390749:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789302178.390759:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121450240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789302178.390802:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302178.390868:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121450240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302178.390875:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789302178.391155:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a14380 x1876219121450240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302178.391173:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121450240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302178.391199:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302178.391205:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121450368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302178.391232:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302178.391352:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121450368 00000100:00100000:1.0:1789302178.391357:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121450368 00000100:00100000:1.0:1789302178.391380:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789302178.391387:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121450368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302178.391398:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302178.391445:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121450368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302178.391451:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789302178.391522:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efdf80 x1876219121450368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302178.391535:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121450368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302178.900303:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121450496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302178.900374:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302178.900650:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121450496 00000100:00100000:2.0:1789302178.900658:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121450496 00000100:00100000:2.0:1789302178.900719:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789302178.900729:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121450496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302178.900763:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789302178.906895:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121450496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6157us (6510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302178.906910:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789302178.908861:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121450496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789302179.220442:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789302179.831484:0:11330:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:0.0:1789302180.251984:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302180.712479:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302180.712536:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302180.712583:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101456128 00000100:00100000:0.0:1789302180.712597:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101456128 00000100:00100000:3.0:1789302180.712630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302180.712654:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 286 00000100:00100000:0.0:1789302180.712666:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2399:x1876219101456128:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302180.712730:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101456384 00000100:00100000:2.0:1789302180.712735:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101456384 00000100:00100000:0.0:1789302180.712777:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2399:x1876219101456128:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302180.712785:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 286 00000100:00100000:2.0:1789302180.712794:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101456256 00000100:00100000:2.0:1789302180.712797:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101456256 00000100:00100000:2.0:1789302180.712817:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111 00000100:00100000:2.0:1789302180.712824:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101456384:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302180.712872:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101456384:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 49us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302180.712879:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111 00000100:00100000:2.0:1789302180.712892:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112 00000100:00100000:2.0:1789302180.712899:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101456256:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302180.712940:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101456256:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302180.712946:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112 00000100:00080000:3.0:1789302180.713168:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302180.713174:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789302181.270249:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302181.460362:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121450624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302181.460468:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302181.460573:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121450624 00000100:00100000:1.0:1789302181.460584:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121450624 00000100:00100000:1.0:1789302181.460649:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789302181.460662:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121450624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302181.460721:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302181.460775:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121450624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302181.460783:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789302181.460830:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383807480 x1876219121450624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302181.460853:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121450624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302181.465456:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121450752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302181.465561:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302181.465747:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121450752 00000100:00100000:1.0:1789302181.465758:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121450752 00000100:00100000:1.0:1789302181.465821:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789302181.465832:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121450752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789302181.465864:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302181.465916:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121450752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302181.465935:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789302181.465986:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efdf80 x1876219121450752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302181.466012:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121450752:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789302181.466801:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789302182.175124:0:11378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 13 08:22:59 EDT 2026 00010000:00010000:2.0:1789302182.300630:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302182.997238:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302182.997272:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121450880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302182.997372:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302182.997509:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121450880 00000100:00100000:3.0:1789302182.997520:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121450880 00000100:00100000:3.0:1789302182.997585:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789302182.997598:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121450880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789302182.997652:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302182.997711:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121450880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302182.997718:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789302182.997875:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121450880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302182.998053:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121451264:0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.998088:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302182.998155:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302182.998161:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121451392:0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.998190:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302182.998223:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121451392 00000100:00100000:0.0:1789302182.998227:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121451392 00000100:00100000:0.0:1789302182.998259:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789302182.998266:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121451392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.998306:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121451392:12345-0@lo:400:kworker.0 Request processed in 40us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302182.998323:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789302182.998351:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121451392:0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.998415:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121451776:0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.998444:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302182.998487:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302182.998494:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121451904:0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.998515:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302182.998561:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121452288:0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.998584:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302182.998633:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302182.998639:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121452416:0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.998678:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302182.998704:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121451776 00000100:00100000:0.0:1789302182.998708:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121451776 00000100:00100000:0.0:1789302182.998731:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121451904 00000100:00100000:0.0:1789302182.998733:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121451904 00000100:00100000:0.0:1789302182.998744:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121452288 00000100:00100000:0.0:1789302182.998747:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121452288 00000100:00100000:0.0:1789302182.998766:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121452416 00000100:00100000:0.0:1789302182.998768:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121452416 00000100:00100000:0.0:1789302182.998781:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789302182.998787:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121451776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.998823:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121451776:12345-0@lo:400:kworker.0 Request processed in 35us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302182.998829:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789302182.998841:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789302182.998847:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121451904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.998882:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121451904:12345-0@lo:400:kworker.0 Request processed in 35us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302182.998890:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789302182.998901:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302182.998907:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121452288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.998941:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121452288:12345-0@lo:400:kworker.0 Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302182.998947:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302182.998957:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789302182.998963:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121452416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302182.999002:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121452416:12345-0@lo:400:kworker.0 Request processed in 39us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302182.999008:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789302182.999033:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef9f80 x1876219121452416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302182.999046:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121452416:0@lo:400:kworker.0 00010000:00080000:0.0:1789302182.999056:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef9180 x1876219121452288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302182.999064:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121452288:0@lo:400:kworker.0 00010000:00080000:0.0:1789302182.999072:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef9500 x1876219121451904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302182.999081:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121451904:0@lo:400:kworker.0 00010000:00080000:0.0:1789302182.999090:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efaa00 x1876219121451776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302182.999104:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121451776:0@lo:400:kworker.0 00000100:00100000:1.0:1789302182.999577:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121451136:0@lo:400:kworker.0 00000100:00100000:1.0:1789302182.999628:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302182.999663:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121451648:0@lo:400:kworker.0 00000100:00100000:1.0:1789302182.999687:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302182.999705:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121452160:0@lo:400:kworker.0 00000100:00100000:1.0:1789302182.999725:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302182.999746:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789302182.999753:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121451008:0@lo:400:kworker.0 00000100:00100000:1.0:1789302182.999781:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302182.999807:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121451520:0@lo:400:kworker.0 00000100:00100000:1.0:1789302182.999829:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302182.999848:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121452032:0@lo:400:kworker.0 00000100:00100000:1.0:1789302182.999869:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302182.999895:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121451136 00000100:00100000:1.0:1789302182.999901:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121451136 00000100:00100000:1.0:1789302182.999941:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121451648 00000100:00100000:1.0:1789302182.999944:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121451648 00000100:00100000:1.0:1789302182.999963:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121452160 00000100:00100000:1.0:1789302182.999966:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121452160 00000100:00100000:1.0:1789302182.999981:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121451520 00000100:00100000:1.0:1789302182.999983:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121451520 00000100:00100000:1.0:1789302182.999994:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121452032 00000100:00100000:1.0:1789302182.999996:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121452032 00000100:00100000:1.0:1789302183.000009:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789302183.000014:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121451136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302183.000055:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121451136:12345-0@lo:400:kworker.0 Request processed in 41us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302183.000076:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789302183.000092:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789302183.000098:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121451648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302183.000159:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121451648:12345-0@lo:400:kworker.0 Request processed in 61us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302183.000164:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789302183.000176:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789302183.000182:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121452160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302183.000209:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121452160:12345-0@lo:400:kworker.0 Request processed in 27us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302183.000214:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789302183.000226:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789302183.000232:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121451520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302183.000257:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121451520:12345-0@lo:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302183.000263:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789302183.000284:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789302183.000289:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121452032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302183.000315:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121452032:12345-0@lo:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302183.000320:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789302183.000369:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121451520:0@lo:400:kworker.0 00000100:00100000:1.0:1789302183.000379:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121452032:0@lo:400:kworker.0 00000100:00100000:1.0:1789302183.000400:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121451136:0@lo:400:kworker.0 00010000:00080000:1.0:1789302183.000410:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef8e00 x1876219121451648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302183.000419:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121451648:0@lo:400:kworker.0 00010000:00080000:1.0:1789302183.000427:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef9880 x1876219121452160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302183.000436:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121452160:0@lo:400:kworker.0 00000100:00100000:2.0:1789302183.000619:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121451264 00000100:00100000:2.0:1789302183.000625:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121451264 00000100:00100000:2.0:1789302183.000671:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789302183.000679:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121451264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302183.000726:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121451264:12345-0@lo:400:kworker.0 Request processed in 47us (2637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302183.000732:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789302183.000764:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302183.000769:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302183.000772:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302183.000785:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121451008 00000100:00100000:2.0:1789302183.000789:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121451008 00000100:00100000:2.0:1789302183.000817:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789302183.000824:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121451008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302183.000861:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121451008:12345-0@lo:400:kworker.0 Request processed in 38us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302183.000868:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789302183.000906:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121451008:0@lo:400:kworker.0 00000100:00100000:2.0:1789302183.000944:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121451264:0@lo:400:kworker.0 00010000:00010000:0.0:1789302183.328648:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302183.509090:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302183.509137:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121452544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302183.509231:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302183.513020:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302183.513053:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121452672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302183.513214:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302183.513296:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121452544 00000100:00100000:1.0:1789302183.513306:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121452544 00000100:00100000:1.0:1789302183.513351:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121452672 00000100:00100000:1.0:1789302183.513355:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121452672 00000100:00100000:1.0:1789302183.513373:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789302183.513384:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121452544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302183.513421:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302183.513470:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121452544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (4239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302183.513478:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789302183.513510:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789302183.513517:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121452672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302183.513527:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302183.513557:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121452672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302183.513583:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789302183.513960:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efea00 x1876219121452672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302183.513983:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121452672:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789302183.514104:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efaa00 x1876219121452544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302183.514147:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121452544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302184.024627:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302184.024657:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121452800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302184.024753:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302184.024844:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121452800 00000100:00100000:1.0:1789302184.024854:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121452800 00000100:00100000:1.0:1789302184.025014:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789302184.025028:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121452800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789302184.025072:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789302184.025160:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121452800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302184.025168:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789302184.025404:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121452800:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789302184.340496:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302185.366317:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302185.813975:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302185.814019:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302185.814047:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302185.814090:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101456512 00000100:00100000:0.0:1789302185.814103:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101456512 00000100:00100000:0.0:1789302185.814180:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 288 00000100:00100000:0.0:1789302185.814191:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2398:x1876219101456512:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302185.814286:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2398:x1876219101456512:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 96us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302185.814295:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 288 00000100:00100000:1.0:1789302185.817841:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101456640 00000100:00100000:1.0:1789302185.817862:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101456640 00000100:00100000:1.0:1789302185.817976:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101456768 00000100:00100000:1.0:1789302185.817980:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101456768 00000100:00100000:1.0:1789302185.818017:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 119 00000100:00100000:1.0:1789302185.818030:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101456640:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302185.818166:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101456640:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 138us (4145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302185.818175:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 119 00000100:00100000:1.0:1789302185.818195:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 120 00000100:00100000:1.0:1789302185.818202:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101456768:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302185.818230:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101456768:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (4182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302185.818257:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 120 00000100:00080000:0.0:1789302185.819319:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302185.819327:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789302186.390852:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302186.584471:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121452928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302186.584578:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302186.584688:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121452928 00000100:00100000:3.0:1789302186.584697:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121452928 00000100:00100000:3.0:1789302186.584788:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789302186.584799:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121452928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789302186.584834:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302186.584898:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121452928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302186.584906:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789302186.584931:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302186.584982:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efed80 x1876219121452928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302186.585004:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121452928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302186.585500:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302186.585514:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121453056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302186.585560:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302186.585617:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121453056 00000100:00100000:0.0:1789302186.585633:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121453056 00000100:00100000:0.0:1789302186.585673:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789302186.585681:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121453056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302186.585696:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302186.585730:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121453056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302186.585736:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789302186.585778:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef9f80 x1876219121453056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302186.585794:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121453056:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789302186.586659:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789302187.413244:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302188.116352:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302188.116373:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121453184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302188.116583:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302188.116688:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121453184 00000100:00100000:0.0:1789302188.116698:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121453184 00000100:00100000:0.0:1789302188.116754:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789302188.116765:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121453184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789302188.116796:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789302188.116854:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121453184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302188.116862:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789302188.116946:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121453184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302188.118387:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121453440:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.118441:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.118467:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121453952:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.118482:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.118496:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121454464:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.118511:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.118529:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789302188.118535:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121453312:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.118557:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.118574:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121453824:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.118589:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.118601:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121454336:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.118615:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.118639:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121453440 00000100:00100000:2.0:1789302188.118646:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121453440 00000100:00100000:2.0:1789302188.118674:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121453952 00000100:00100000:2.0:1789302188.118677:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121453952 00000100:00100000:2.0:1789302188.118698:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121454464 00000100:00100000:2.0:1789302188.118701:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121454464 00000100:00100000:2.0:1789302188.118713:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121453824 00000100:00100000:2.0:1789302188.118715:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121453824 00000100:00100000:2.0:1789302188.118724:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121454336 00000100:00100000:2.0:1789302188.118725:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121454336 00000100:00100000:2.0:1789302188.118736:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789302188.118741:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121453440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.118788:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121453440:12345-0@lo:400:kworker.0 Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302188.118794:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789302188.118807:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789302188.118812:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121453952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.118830:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121453952:12345-0@lo:400:kworker.0 Request processed in 19us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302188.118834:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789302188.118843:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789302188.118847:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121454464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.118863:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121454464:12345-0@lo:400:kworker.0 Request processed in 17us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302188.118868:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789302188.118875:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789302188.118891:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121453824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.118911:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121453824:12345-0@lo:400:kworker.0 Request processed in 21us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302188.118915:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789302188.118923:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789302188.118927:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121454336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.118943:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121454336:12345-0@lo:400:kworker.0 Request processed in 16us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302188.118947:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789302188.118964:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121453312 00000100:00100000:2.0:1789302188.118967:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121453312 00000100:00100000:2.0:1789302188.118993:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789302188.118997:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121453312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.119029:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121453312:12345-0@lo:400:kworker.0 Request processed in 31us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302188.119604:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:2.0:1789302188.119646:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302188.119650:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789302188.119665:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121453696:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.119700:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.119730:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121454208:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.119759:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.119779:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121454720:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.119799:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.119817:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789302188.119822:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121453568:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.119843:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.119861:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121454080:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.119891:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.119907:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121454592:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.119928:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.119959:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121454208 00000100:00100000:2.0:1789302188.119963:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121454208 00000100:00100000:2.0:1789302188.119990:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121454720 00000100:00100000:2.0:1789302188.119993:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121454720 00000100:00100000:2.0:1789302188.120004:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121454080 00000100:00100000:2.0:1789302188.120007:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121454080 00000100:00100000:2.0:1789302188.120018:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121454592 00000100:00100000:2.0:1789302188.120027:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121454592 00000100:00100000:0.0:1789302188.120513:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121453696 00000100:00100000:0.0:1789302188.120518:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121453696 00000100:00100000:0.0:1789302188.120551:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789302188.120560:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121453696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302188.120608:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121453696:12345-0@lo:400:kworker.0 Request processed in 49us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302188.120615:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789302188.120662:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121453696:0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.121379:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789302188.121387:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121454208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.121444:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121454208:12345-0@lo:400:kworker.0 Request processed in 57us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302188.121451:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789302188.121459:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789302188.121469:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121454720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302188.121471:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789302188.121483:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121454080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302188.121509:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121454720:12345-0@lo:400:kworker.0 Request processed in 41us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302188.121517:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789302188.121524:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121454080:12345-0@lo:400:kworker.0 Request processed in 43us (1631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302188.121532:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789302188.121538:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789302188.121547:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121454592:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789302188.121561:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302188.121566:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302188.121580:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121454592:12345-0@lo:400:kworker.0 Request processed in 35us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302188.121586:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789302188.121606:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121453568 00000100:00100000:3.0:1789302188.121611:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121453568 00000100:00100000:3.0:1789302188.121696:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789302188.121702:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121453568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302188.121727:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121453568:12345-0@lo:400:kworker.0 Request processed in 27us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302188.121732:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789302188.121760:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121453312:0@lo:400:kworker.0 00000100:00100000:3.0:1789302188.121770:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121453824:0@lo:400:kworker.0 00000100:00100000:3.0:1789302188.121776:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121454336:0@lo:400:kworker.0 00000100:00100000:3.0:1789302188.121802:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121453440:0@lo:400:kworker.0 00010000:00080000:3.0:1789302188.121812:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef8a80 x1876219121453952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302188.121819:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121453952:0@lo:400:kworker.0 00010000:00080000:3.0:1789302188.121827:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efb480 x1876219121454464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302188.121832:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121454464:0@lo:400:kworker.0 00000100:00100000:0.0:1789302188.125327:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121453568:0@lo:400:kworker.0 00010000:00080000:0.0:1789302188.125350:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efa680 x1876219121454080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302188.125361:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121454080:0@lo:400:kworker.0 00010000:00080000:0.0:1789302188.125376:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384051180 x1876219121454592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302188.125385:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121454592:0@lo:400:kworker.0 00010000:00080000:0.0:1789302188.125397:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef9880 x1876219121454208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302188.125406:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121454208:0@lo:400:kworker.0 00010000:00080000:0.0:1789302188.125418:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384050000 x1876219121454720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302188.125426:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121454720:0@lo:400:kworker.0 00010000:00010000:2.0:1789302188.436822:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302188.628332:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302188.628354:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121454848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302188.628420:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302188.630983:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121454848 00000100:00100000:3.0:1789302188.630996:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121454848 00000100:00100000:3.0:1789302188.631051:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789302188.631062:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121454848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302188.631090:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302188.631186:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121454848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302188.631193:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1789302188.631236:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f7fb80 x1876219121454848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302188.631255:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121454848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302188.631733:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302188.631745:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121454976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302188.631778:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302188.631823:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121454976 00000100:00100000:2.0:1789302188.631827:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121454976 00000100:00100000:2.0:1789302188.631846:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789302188.631852:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121454976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789302188.631862:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302188.631905:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121454976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302188.631911:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789302188.631935:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383416300 x1876219121454976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302188.631962:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121454976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302189.140909:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121455104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302189.140990:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302189.141069:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121455104 00000100:00100000:2.0:1789302189.141076:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121455104 00000100:00100000:2.0:1789302189.141135:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789302189.141145:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121455104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302189.141177:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789302189.141223:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121455104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302189.141230:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789302189.141273:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121455104:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789302189.460426:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302190.484290:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302190.930513:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302190.930566:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302190.930590:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302190.930617:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101457152 00000100:00100000:3.0:1789302190.930626:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101457152 00000100:00100000:3.0:1789302190.930782:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101457024 00000100:00100000:3.0:1789302190.930802:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101457024 00000100:00100000:3.0:1789302190.930828:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 127 00000100:00100000:3.0:1789302190.930837:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101457152:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302190.930915:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101457152:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 79us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302190.930922:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 127 00000100:00100000:3.0:1789302190.930936:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 128 00000100:00100000:3.0:1789302190.930941:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2396:x1876219101457024:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302190.930966:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2396:x1876219101457024:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302190.930972:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 128 00000100:00080000:3.0:1789302190.930987:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302190.930991:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789302190.931243:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101456896 00000100:00100000:2.0:1789302190.931248:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101456896 00000100:00100000:2.0:1789302190.931316:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 290 00000100:00100000:2.0:1789302190.931323:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2396:x1876219101456896:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302190.931354:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2396:x1876219101456896:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 32us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302190.931359:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 290 00010000:00010000:2.0:1789302191.508561:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302191.700371:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302191.700393:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121455232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302191.700454:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302191.701191:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121455360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302191.701225:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302191.701274:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121455232 00000100:00100000:0.0:1789302191.701281:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121455232 00000100:00100000:0.0:1789302191.701320:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121455360 00000100:00100000:0.0:1789302191.701322:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121455360 00000100:00100000:0.0:1789302191.701337:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789302191.701344:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121455232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302191.701370:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302191.701419:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121455232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302191.701426:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789302191.701441:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789302191.701447:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121455360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302191.701456:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302191.701481:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121455360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302191.701486:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789302191.701500:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302191.701524:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efce00 x1876219121455232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302191.701553:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121455232:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789302191.701599:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384050000 x1876219121455360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302191.701611:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121455360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789302192.532336:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302193.236295:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121455488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302193.236374:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302193.236514:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121455488 00000100:00100000:1.0:1789302193.236523:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121455488 00000100:00100000:1.0:1789302193.236574:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789302193.236583:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121455488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789302193.236615:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789302193.236670:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121455488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302193.236676:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789302193.236822:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121455488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302193.237222:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121456000:0@lo:400:kworker.0 00000100:00100000:3.0:1789302193.237259:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302193.237459:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121456512:0@lo:400:kworker.0 00000100:00100000:3.0:1789302193.237493:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302193.237522:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121457024:0@lo:400:kworker.0 00000100:00100000:3.0:1789302193.237562:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302193.237584:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789302193.237591:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121455872:0@lo:400:kworker.0 00000100:00100000:3.0:1789302193.237620:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302193.237639:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121456384:0@lo:400:kworker.0 00000100:00100000:3.0:1789302193.237667:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302193.237692:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121456896:0@lo:400:kworker.0 00000100:00100000:3.0:1789302193.237714:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302193.237741:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121456512 00000100:00100000:3.0:1789302193.237746:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121456512 00000100:00100000:3.0:1789302193.237788:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121457024 00000100:00100000:3.0:1789302193.237791:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121457024 00000100:00100000:3.0:1789302193.237812:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121456384 00000100:00100000:3.0:1789302193.237815:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121456384 00000100:00100000:3.0:1789302193.237835:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121456896 00000100:00100000:3.0:1789302193.237838:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121456896 00000100:00100000:3.0:1789302193.237871:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789302193.237880:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121456512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302193.237924:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121456512:12345-0@lo:400:kworker.0 Request processed in 46us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302193.237930:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789302193.237957:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789302193.237964:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121457024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302193.237991:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121457024:12345-0@lo:400:kworker.0 Request processed in 29us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302193.237997:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789302193.238006:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789302193.238019:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121456384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.238185:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121456000 00000100:00100000:2.0:1789302193.238189:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121456000 00000100:00100000:2.0:1789302193.238220:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789302193.238227:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121456000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.238267:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121456000:12345-0@lo:400:kworker.0 Request processed in 40us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302193.238275:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789302193.238296:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789302193.238317:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121456896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.238344:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121456896:12345-0@lo:400:kworker.0 Request processed in 42us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302193.238348:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789302193.238369:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121455872 00000100:00100000:2.0:1789302193.238372:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121455872 00000100:00100000:2.0:1789302193.238393:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789302193.238398:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121455872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.238529:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121455872:12345-0@lo:400:kworker.0 Request processed in 129us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302193.238535:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789302193.238578:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121456384:12345-0@lo:400:kworker.0 Request processed in 558us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302193.238584:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789302193.241016:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121455872:0@lo:400:kworker.0 00010000:00080000:3.0:1789302193.241038:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383be7800 x1876219121456384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302193.241050:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121456384:0@lo:400:kworker.0 00010000:00080000:3.0:1789302193.241065:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383be7100 x1876219121456896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302193.241073:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121456896:0@lo:400:kworker.0 00000100:00100000:0.0:1789302193.241084:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121455616:0@lo:400:kworker.0 00000100:00100000:3.0:1789302193.241088:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121456000:0@lo:400:kworker.0 00010000:00080000:3.0:1789302193.241102:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383be4380 x1876219121456512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302193.241125:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121456512:0@lo:400:kworker.0 00010000:00080000:3.0:1789302193.241139:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383be6d80 x1876219121457024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302193.241149:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121457024:0@lo:400:kworker.0 00000100:00100000:0.0:1789302193.241663:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302193.241710:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121455616 00000100:00100000:0.0:1789302193.241712:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121456128:0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.241721:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121455616 00000100:00100000:0.0:1789302193.241750:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302193.241773:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789302193.241784:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121456640:0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.241786:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121455616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302193.241824:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302193.241852:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121455616:12345-0@lo:400:kworker.0 Request processed in 59us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302193.241859:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789302193.241882:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121455616:0@lo:400:kworker.0 00000100:00100000:0.0:1789302193.241916:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789302193.241926:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121455744:0@lo:400:kworker.0 00000100:00100000:0.0:1789302193.241949:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302193.242012:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121456128 00000100:00100000:2.0:1789302193.242016:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121456128 00000100:00100000:2.0:1789302193.242037:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121456640 00000100:00100000:2.0:1789302193.242039:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121456640 00000100:00100000:2.0:1789302193.242048:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121455744 00000100:00100000:2.0:1789302193.242054:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121455744 00000100:00100000:2.0:1789302193.242065:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789302193.242070:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121456128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.242110:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121456128:12345-0@lo:400:kworker.0 Request processed in 39us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302193.242137:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789302193.242148:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789302193.242154:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121456640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.242173:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121456640:12345-0@lo:400:kworker.0 Request processed in 20us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302193.242177:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789302193.242183:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789302193.242186:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121455744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.242199:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121455744:12345-0@lo:400:kworker.0 Request processed in 13us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302193.242202:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789302193.242537:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121456256:0@lo:400:kworker.0 00000100:00100000:0.0:1789302193.242567:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302193.242591:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121456768:0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.242604:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121456256 00000100:00100000:2.0:1789302193.242610:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121456256 00000100:00100000:0.0:1789302193.242618:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302193.242643:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121456768 00000100:00100000:2.0:1789302193.242648:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121456768 00000100:00100000:0.0:1789302193.242652:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121456128:0@lo:400:kworker.0 00000100:00100000:0.0:1789302193.242667:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121456640:0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.242673:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789302193.242683:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121456256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302193.242694:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121455744:0@lo:400:kworker.0 00000100:00100000:2.0:1789302193.242717:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121456256:12345-0@lo:400:kworker.0 Request processed in 36us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302193.242722:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1789302193.242726:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302193.242732:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302193.242735:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1789302193.242737:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302193.242741:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121456768:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789302193.242742:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302193.242781:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121456768:12345-0@lo:400:kworker.0 Request processed in 39us (163us total) trans 0 rc 0/0 00010000:00080000:0.0:1789302193.242788:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f0b480 x1876219121456256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302193.242789:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789302193.242802:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121456256:0@lo:400:kworker.0 00010000:00080000:0.0:1789302193.242815:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383be5c00 x1876219121456768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302193.242823:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121456768:0@lo:400:kworker.0 00010000:00010000:1.0:1789302193.564733:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302193.753247:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302193.753270:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121457152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302193.753337:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302193.753403:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121457152 00000100:00100000:1.0:1789302193.753409:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121457152 00000100:00100000:1.0:1789302193.753451:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789302193.753460:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121457152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302193.753491:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302193.753538:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121457152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302193.753557:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789302193.753586:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121457280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302193.753609:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789302193.753745:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383be4a80 x1876219121457152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302193.753761:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121457152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302193.753891:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121457280 00000100:00100000:0.0:1789302193.753896:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121457280 00000100:00100000:0.0:1789302193.754174:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789302193.754184:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121457280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302193.754205:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302193.754247:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121457280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302193.754255:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1789302193.754334:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384051c00 x1876219121457280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302193.754350:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121457280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302194.261556:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302194.261595:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121457408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302194.261662:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302194.261911:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121457408 00000100:00100000:1.0:1789302194.261920:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121457408 00000100:00100000:1.0:1789302194.261971:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789302194.261981:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121457408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789302194.262021:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789302194.262084:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121457408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302194.262091:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789302194.262716:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121457408:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789302194.587195:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302195.604338:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302196.051634:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302196.051677:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302196.051727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302196.052032:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101457280 00000100:00100000:2.0:1789302196.052043:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101457280 00000100:00100000:2.0:1789302196.052108:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 292 00000100:00100000:2.0:1789302196.052155:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2397:x1876219101457280:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302196.052221:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2397:x1876219101457280:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 68us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302196.052228:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 292 00000100:00100000:2.0:1789302196.052269:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101457536 00000100:00100000:2.0:1789302196.052272:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101457536 00000100:00100000:2.0:1789302196.052306:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101457408 00000100:00100000:2.0:1789302196.052309:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101457408 00000100:00100000:2.0:1789302196.052328:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 135 00000100:00100000:2.0:1789302196.052334:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101457536:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302196.052362:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101457536:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302196.052368:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 135 00000100:00100000:2.0:1789302196.052379:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 136 00000100:00100000:2.0:1789302196.052386:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2397:x1876219101457408:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302196.052408:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2397:x1876219101457408:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302196.052413:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 136 00000100:00080000:0.0:1789302196.056869:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302196.056880:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789302196.628733:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302196.820527:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121457536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302196.820597:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302196.820783:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121457536 00000100:00100000:0.0:1789302196.820792:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121457536 00000100:00100000:0.0:1789302196.820873:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789302196.820884:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121457536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302196.820909:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302196.820970:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121457536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302196.820977:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1789302196.821021:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384053100 x1876219121457536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302196.821039:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121457536:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789302196.821311:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302196.821955:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121457664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302196.822016:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302196.822152:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121457664 00000100:00100000:2.0:1789302196.822159:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121457664 00000100:00100000:2.0:1789302196.822219:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789302196.822228:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121457664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789302196.822242:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302196.822281:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121457664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302196.822288:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789302196.822328:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f0ad80 x1876219121457664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302196.822343:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121457664:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789302196.822492:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789302197.652428:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302198.356682:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121457792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302198.356779:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302198.357674:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121457792 00000100:00100000:2.0:1789302198.357687:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121457792 00000100:00100000:2.0:1789302198.357771:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789302198.357782:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121457792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302198.357836:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789302198.362727:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302198.362749:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121457920:0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.362851:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302198.362924:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121458048:0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.362954:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302198.363003:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121458048 00000100:00100000:0.0:1789302198.363012:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121458048 00000100:00100000:0.0:1789302198.363070:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789302198.363080:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121458048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363165:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121458048:12345-0@lo:400:kworker.0 Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302198.363173:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789302198.363221:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121458048:0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363278:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302198.363284:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121458432:0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363308:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302198.363347:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121458560:0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363369:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302198.363417:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302198.363423:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121458944:0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363447:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302198.363484:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121459072:0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363508:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302198.363529:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121458432 00000100:00100000:0.0:1789302198.363533:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121458432 00000100:00100000:0.0:1789302198.363560:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121458560 00000100:00100000:0.0:1789302198.363563:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121458560 00000100:00100000:0.0:1789302198.363577:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121458944 00000100:00100000:0.0:1789302198.363579:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121458944 00000100:00100000:0.0:1789302198.363591:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121459072 00000100:00100000:0.0:1789302198.363593:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121459072 00000100:00100000:0.0:1789302198.363607:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789302198.363613:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121458432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363656:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121458432:12345-0@lo:400:kworker.0 Request processed in 42us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302198.363663:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789302198.363675:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789302198.363681:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121458560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363705:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121458560:12345-0@lo:400:kworker.0 Request processed in 25us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302198.363711:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789302198.363721:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789302198.363727:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121458944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363751:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121458944:12345-0@lo:400:kworker.0 Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302198.363757:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789302198.363767:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789302198.363773:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121459072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363798:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121459072:12345-0@lo:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302198.363804:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1789302198.363833:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302198.363837:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789302198.363856:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f7fb80 x1876219121459072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302198.363869:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121459072:0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363879:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121458944:0@lo:400:kworker.0 00010000:00080000:0.0:1789302198.363901:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384051500 x1876219121458560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302198.363910:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121458560:0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.363919:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121458432:0@lo:400:kworker.0 00000100:00100000:3.0:1789302198.364303:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121458176:0@lo:400:kworker.0 00000100:00100000:3.0:1789302198.364347:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302198.364393:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121458688:0@lo:400:kworker.0 00000100:00100000:3.0:1789302198.364438:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302198.364462:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121459200:0@lo:400:kworker.0 00000100:00100000:3.0:1789302198.364486:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302198.364507:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789302198.364514:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121458304:0@lo:400:kworker.0 00000100:00100000:3.0:1789302198.364538:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302198.364553:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121458816:0@lo:400:kworker.0 00000100:00100000:3.0:1789302198.364574:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302198.364590:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121459328:0@lo:400:kworker.0 00000100:00100000:3.0:1789302198.364609:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302198.364703:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121458688 00000100:00100000:3.0:1789302198.364710:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121458688 00000100:00100000:3.0:1789302198.364746:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121459200 00000100:00100000:3.0:1789302198.364749:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121459200 00000100:00100000:3.0:1789302198.364760:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121458816 00000100:00100000:3.0:1789302198.364769:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121458816 00000100:00100000:3.0:1789302198.364785:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121459328 00000100:00100000:3.0:1789302198.364787:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121459328 00000100:00100000:3.0:1789302198.364802:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789302198.364820:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121458688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302198.364864:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121458688:12345-0@lo:400:kworker.0 Request processed in 45us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302198.364871:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789302198.364885:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789302198.364891:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121459200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302198.364917:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121459200:12345-0@lo:400:kworker.0 Request processed in 27us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302198.364923:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789302198.364934:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789302198.364939:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121458816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302198.364966:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121458816:12345-0@lo:400:kworker.0 Request processed in 27us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302198.364972:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789302198.364983:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789302198.364988:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121459328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302198.365011:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121459328:12345-0@lo:400:kworker.0 Request processed in 23us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302198.365017:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1789302198.365052:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384051880 x1876219121458816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302198.365066:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121458816:0@lo:400:kworker.0 00010000:00080000:3.0:1789302198.365085:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef9c00 x1876219121459328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302198.365094:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121459328:0@lo:400:kworker.0 00010000:00080000:3.0:1789302198.365103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384053480 x1876219121458688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302198.365147:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121458688:0@lo:400:kworker.0 00010000:00080000:3.0:1789302198.365158:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efa680 x1876219121459200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302198.365166:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121459200:0@lo:400:kworker.0 00000100:00100000:2.0:1789302198.367334:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121457792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9540us (10541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302198.367353:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789302198.367394:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121458176 00000100:00100000:2.0:1789302198.367404:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121458176 00000100:00100000:2.0:1789302198.367484:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789302198.367670:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121458176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302198.367893:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121458176:12345-0@lo:400:kworker.0 Request processed in 227us (3544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302198.367901:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789302198.367960:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121457920 00000100:00100000:2.0:1789302198.367965:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121457920 00000100:00100000:2.0:1789302198.367995:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789302198.368003:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121457920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302198.368050:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121457920:12345-0@lo:400:kworker.0 Request processed in 48us (5199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302198.369396:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789302198.370175:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121458304 00000100:00100000:0.0:1789302198.370188:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121458304 00000100:00100000:0.0:1789302198.370258:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789302198.370270:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121458304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302198.370374:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121458304:12345-0@lo:400:kworker.0 Request processed in 106us (5834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302198.370380:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1789302198.370412:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302198.370419:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302198.370425:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121458304:0@lo:400:kworker.0 00000100:00100000:2.0:1789302198.370441:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121458176:0@lo:400:kworker.0 00000100:00100000:2.0:1789302198.370679:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121457920:0@lo:400:kworker.0 00000100:00100000:1.0:1789302198.373254:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121457792:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789302198.456481:0:12007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:23:16 (1789302196) === 00010000:00010000:1.0:1789302198.676481:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302198.868454:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302198.868521:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121459456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302198.868600:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302198.869278:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121459456 00000100:00100000:3.0:1789302198.869291:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121459456 00000100:00100000:3.0:1789302198.869400:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789302198.869411:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121459456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302198.869448:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302198.869516:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121459456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302198.869523:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1789302198.869604:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383be7b80 x1876219121459456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302198.869628:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121459456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302198.869811:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302198.869825:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121459584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302198.869860:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302198.870190:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121459584 00000100:00100000:2.0:1789302198.870196:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121459584 00000100:00100000:2.0:1789302198.870244:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789302198.870252:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121459584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789302198.870265:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302198.870310:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121459584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302198.870317:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1789302198.870474:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef8a80 x1876219121459584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302198.870498:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121459584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302199.041512:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302199.042381:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101457664 00000100:00100000:3.0:1789302199.042414:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101457664 00000100:00100000:3.0:1789302199.042509:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 294 00000100:00100000:3.0:1789302199.042521:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:8733:x1876219101457664:12345-192.168.203.9@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789302199.042541:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302199.042564:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166fe00/0x1ff82925bd3993c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a595c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302199.042601:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166fe00/0x1ff82925bd3993c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a595c expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302199.042615:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166fe00/0x1ff82925bd3993c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a595c expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302199.042626:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166fe00, rc 0) 00000100:00100000:3.0:1789302199.042703:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8733:x1876219101457664:12345-192.168.203.9@tcp:101:mount.lustre.0 Request processed in 184us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302199.042710:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 294 00000100:00100000:2.0:1789302199.046960:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302199.047075:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101457792 00000100:00100000:0.0:1789302199.047088:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101457792 00000100:00100000:0.0:1789302199.047194:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 295 00000100:00100000:0.0:1789302199.047206:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8733:x1876219101457792:12345-192.168.203.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789302199.047422:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8733:x1876219101457792:12345-192.168.203.9@tcp:501:mount.lustre.0 Request processed in 217us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302199.047431:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 295 00000100:00100000:0.0:1789302199.056933:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302199.057248:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101457920 00000100:00100000:2.0:1789302199.057260:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101457920 00000100:00100000:2.0:1789302199.057327:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 296 00000100:00100000:2.0:1789302199.057345:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8733:x1876219101457920:12345-192.168.203.9@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789302199.057702:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8733:x1876219101457920:12345-192.168.203.9@tcp:503:mount.lustre.0 Request processed in 357us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302199.057711:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 296 00000100:00100000:2.0:1789302199.075223:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302199.075744:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101458048 00000100:00100000:3.0:1789302199.075759:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101458048 00000100:00100000:3.0:1789302199.075857:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 297 00000100:00100000:3.0:1789302199.075869:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8737:x1876219101458048:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789302199.076094:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8737:x1876219101458048:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 227us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302199.076103:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 297 00000100:00100000:3.0:1789302199.141634:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302199.145667:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101458176 00000100:00100000:2.0:1789302199.145690:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101458176 00000100:00100000:2.0:1789302199.145792:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 298 00000100:00100000:2.0:1789302199.145814:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8737:x1876219101458176:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789302199.146041:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8737:x1876219101458176:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 238us (4421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302199.146050:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 298 00000100:00100000:1.0:1789302199.155370:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302199.156171:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101458304 00000100:00100000:0.0:1789302199.156186:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101458304 00000100:00100000:0.0:1789302199.156273:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 299 00000100:00100000:0.0:1789302199.156286:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8737:x1876219101458304:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302199.156492:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8737:x1876219101458304:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 208us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302199.156501:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 299 00000100:00100000:1.0:1789302199.161787:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302199.161858:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101458432 00000100:00100000:3.0:1789302199.161872:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101458432 00000100:00100000:3.0:1789302199.161971:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 300 00000100:00100000:3.0:1789302199.161984:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:8733:x1876219101458432:12345-192.168.203.9@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789302199.162007:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302199.162032:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166f800/0x1ff82925bd3993cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a598d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302199.162070:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166f800/0x1ff82925bd3993cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a598d expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302199.162084:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166f800/0x1ff82925bd3993cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a598d expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302199.162095:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f800, rc 0) 00000100:00100000:3.0:1789302199.162196:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:8733:x1876219101458432:12345-192.168.203.9@tcp:101:mount.lustre.0 Request processed in 215us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302199.162204:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 300 00000100:00100000:3.0:1789302199.166760:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302199.167211:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101458560 00000100:00100000:0.0:1789302199.167224:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101458560 00000100:00100000:0.0:1789302199.167302:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 301 00000100:00100000:0.0:1789302199.167314:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:8733:x1876219101458560:12345-192.168.203.9@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789302199.167349:0:6524:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789302199.167386:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789302199.167391:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789302199.167394:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789302199.167397:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789302199.167399:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789302199.169445:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:8733:x1876219101458560:12345-192.168.203.9@tcp:256:mount.lustre.0 Request processed in 2119us (2685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302199.169460:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 301 00000100:00100000:1.0:1789302199.189201:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302199.189315:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101458688 00000100:00100000:2.0:1789302199.189329:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101458688 00000100:00100000:2.0:1789302199.189399:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 302 00000100:00100000:2.0:1789302199.189411:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:8733:x1876219101458688:12345-192.168.203.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789302199.189433:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302199.189457:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd3993d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5994 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302199.189496:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd3993d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5994 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302199.189508:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd3993d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5994 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302199.189519:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349e00, rc 0) 00000100:00100000:2.0:1789302199.189608:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:8733:x1876219101458688:12345-192.168.203.9@tcp:101:mount.lustre.0 Request processed in 199us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302199.189616:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 302 00000100:00100000:3.0:1789302199.194174:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302199.194529:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101458816 00000100:00100000:0.0:1789302199.194544:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101458816 00000100:00100000:0.0:1789302199.194614:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 303 00000100:00100000:0.0:1789302199.194626:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:8733:x1876219101458816:12345-192.168.203.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789302199.194845:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:8733:x1876219101458816:12345-192.168.203.9@tcp:501:mount.lustre.0 Request processed in 221us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302199.194855:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 303 00000100:00100000:1.0:1789302199.198526:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302199.198611:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101458944 00000100:00100000:3.0:1789302199.198624:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101458944 00000100:00100000:3.0:1789302199.198699:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 304 00000100:00100000:3.0:1789302199.198724:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:8733:x1876219101458944:12345-192.168.203.9@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789302199.198928:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:8733:x1876219101458944:12345-192.168.203.9@tcp:503:mount.lustre.0 Request processed in 219us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302199.198937:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 304 00000100:00100000:1.0:1789302199.206620:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302199.206895:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101459072 00000100:00100000:0.0:1789302199.206909:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101459072 00000100:00100000:0.0:1789302199.206986:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 305 00000100:00100000:0.0:1789302199.206999:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:8744:x1876219101459072:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302199.207606:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:8744:x1876219101459072:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 603us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302199.207616:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 305 00000100:00100000:0.0:1789302199.222539:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302199.222675:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101459200 00000100:00100000:2.0:1789302199.222687:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101459200 00000100:00100000:2.0:1789302199.222755:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 306 00000100:00100000:2.0:1789302199.222768:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:8744:x1876219101459200:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789302199.223084:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:8744:x1876219101459200:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 318us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302199.223094:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 306 00000100:00100000:1.0:1789302199.228898:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302199.228942:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302199.228988:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302199.229089:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302199.234286:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101460096 00000100:00100000:3.0:1789302199.234308:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101460096 00000100:00100000:0.0:1789302199.234381:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101459328 00000100:00100000:0.0:1789302199.234388:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101459328 00000100:00100000:0.0:1789302199.234412:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101459584 00000100:00100000:0.0:1789302199.234415:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101459584 00000100:00100000:0.0:1789302199.234476:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00100000:0.0:1789302199.234487:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1876219101459584:12345-192.168.203.9@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789302199.234528:0:10111:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from fadf847f-5c0c-4967-b509-d18868692ac4@192.168.203.9@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:0.0:1789302199.234579:0:10111:0:(genops.c:1384:class_connect()) connect: client fadf847f-5c0c-4967-b509-d18868692ac4, cookie 0x1ff82925bd3993da 00000004:00100000:0.0:1789302199.234612:0:10111:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789302199.235881:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 143 00000100:00100000:3.0:1789302199.235906:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101460096:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302199.236017:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101460096:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 124us (7135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302199.236026:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 143 00000100:00080000:3.0:1789302199.236063:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302199.236417:0:10111:0:(import.c:65:import_set_state_nolock()) ffff8cc381f37000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302199.236483:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+6:2395:x1876219101459584:12345-192.168.203.9@tcp:38:mount.lustre.0 Request processed in 1995us (7392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302199.236494:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00100000:2.0:1789302199.236563:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101459968 00000100:00100000:0.0:1789302199.236569:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:2.0:1789302199.236576:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101459968 00000100:00100000:0.0:1789302199.236578:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1876219101459328:12345-192.168.203.9@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789302199.236625:0:6532:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fadf847f-5c0c-4967-b509-d18868692ac4@192.168.203.9@tcp t0 exp 0000000000000000 cur 275 last 0 00000100:00100000:2.0:1789302199.236660:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 144 00000020:00000080:0.0:1789302199.236665:0:6532:0:(genops.c:1384:class_connect()) connect: client fadf847f-5c0c-4967-b509-d18868692ac4, cookie 0x1ff82925bd3993e1 00000100:00100000:2.0:1789302199.236674:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101459968:12345-192.168.203.9@tcp:400:kworker.0 00000004:00100000:0.0:1789302199.236691:0:6532:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789302199.236737:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101459968:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 66us (7793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302199.236746:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 144 00000100:00080000:0.0:1789302199.236789:0:6532:0:(import.c:65:import_set_state_nolock()) ffff8cc381f32000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789302199.236918:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302199.236940:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+6:2395:x1876219101459328:12345-192.168.203.9@tcp:38:mount.lustre.0 Request processed in 359us (7949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302199.236949:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:1.0:1789302199.252853:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302199.253183:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101459840 00000100:00100000:2.0:1789302199.253197:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101459840 00000100:00100000:2.0:1789302199.253302:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:2.0:1789302199.253315:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+6:8733:x1876219101459840:12345-192.168.203.9@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789302199.253367:0:9541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789302199.253489:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+6:8733:x1876219101459840:12345-192.168.203.9@tcp:41:mount.lustre.0 Request processed in 177us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302199.253497:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00080000:3.0:1789302199.253988:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302199.259509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302199.259562:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302199.259669:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302199.260208:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101459712 00000100:00100000:3.0:1789302199.260230:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101459712 00000100:00100000:3.0:1789302199.260305:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101459456 00000100:00100000:3.0:1789302199.260308:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101459456 00000100:00100000:3.0:1789302199.260327:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101460224 00000100:00100000:3.0:1789302199.260329:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101460224 00000100:00100000:3.0:1789302199.260343:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00100000:3.0:1789302199.260353:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+6:0:x1876219101459712:12345-192.168.203.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789302199.260409:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302199.260527:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+6:0:x1876219101459712:12345-192.168.203.9@tcp:41:mount.lustre.0 Request processed in 174us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302199.260534:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00100000:3.0:1789302199.260555:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:3.0:1789302199.260562:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+7:0:x1876219101459456:12345-192.168.203.9@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789302199.260575:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789302199.260605:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+7:0:x1876219101459456:12345-192.168.203.9@tcp:41:mount.lustre.0 Request processed in 43us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302199.260611:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:3.0:1789302199.260623:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:3.0:1789302199.260628:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+6:8733:x1876219101460224:12345-192.168.203.9@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789302199.260673:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+6:8733:x1876219101460224:12345-192.168.203.9@tcp:40:mount.lustre.0 Request processed in 45us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302199.260680:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00080000:2.0:1789302199.261411:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789302199.273379:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302199.277007:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101460608 00000100:00100000:0.0:1789302199.277027:0:6541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101460608 00000100:00100000:0.0:1789302199.277163:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5 00000100:00100000:0.0:1789302199.277176:0:6541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fadf847f-5c0c-4967-b509-d18868692ac4+6:8733:x1876219101460608:12345-192.168.203.9@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789302199.277297:0:6541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fadf847f-5c0c-4967-b509-d18868692ac4+6:8733:x1876219101460608:12345-192.168.203.9@tcp:900:mount.lustre.0 Request processed in 123us (3930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302199.277306:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5 00000100:00100000:3.0:1789302199.286773:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302199.287062:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101460352 00000100:00100000:0.0:1789302199.287075:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101460352 00000100:00100000:0.0:1789302199.287168:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:0.0:1789302199.287179:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1876219101460352:12345-192.168.203.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789302199.287229:0:8447:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fadf847f-5c0c-4967-b509-d18868692ac4@192.168.203.9@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:0.0:1789302199.287271:0:8447:0:(genops.c:1384:class_connect()) connect: client fadf847f-5c0c-4967-b509-d18868692ac4, cookie 0x1ff82925bd3993e8 00002000:00100000:0.0:1789302199.287286:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fadf847f-5c0c-4967-b509-d18868692ac4/ffff8cc381fcb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789302199.287308:0:8447:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789302199.287409:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789302199.287448:0:8447:0:(import.c:65:import_set_state_nolock()) ffff8cc381fca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302199.287553:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fadf847f-5c0c-4967-b509-d18868692ac4+6:2395:x1876219101460352:12345-192.168.203.9@tcp:8:mount.lustre.0 Request processed in 374us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302199.287562:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:2.0:1789302199.292009:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302199.294365:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101460480 00000100:00100000:0.0:1789302199.294417:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101460480 00000100:00100000:0.0:1789302199.294506:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:0.0:1789302199.294516:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1876219101460480:12345-192.168.203.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789302199.294566:0:8446:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fadf847f-5c0c-4967-b509-d18868692ac4@192.168.203.9@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:0.0:1789302199.294630:0:8446:0:(genops.c:1384:class_connect()) connect: client fadf847f-5c0c-4967-b509-d18868692ac4, cookie 0x1ff82925bd3993ef 00002000:00100000:0.0:1789302199.294646:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fadf847f-5c0c-4967-b509-d18868692ac4/ffff8cc4adef1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789302199.294662:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789302199.294998:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789302199.295041:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8cc4adef2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302199.295367:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fadf847f-5c0c-4967-b509-d18868692ac4+6:2395:x1876219101460480:12345-192.168.203.9@tcp:8:mount.lustre.0 Request processed in 848us (3371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302199.295376:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:1.0:1789302199.299510:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302199.299756:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101460736 00000100:00100000:3.0:1789302199.299769:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101460736 00000100:00100000:3.0:1789302199.299855:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1 00000100:00100000:3.0:1789302199.299868:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fadf847f-5c0c-4967-b509-d18868692ac4+6:8733:x1876219101460736:12345-192.168.203.9@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789302199.299985:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789302199.300097:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fadf847f-5c0c-4967-b509-d18868692ac4+6:8733:x1876219101460736:12345-192.168.203.9@tcp:33:mount.lustre.0 Request processed in 232us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302199.300105:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1 00000100:00100000:3.0:1789302199.384100:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121459712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302199.384247:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302199.384421:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121459712 00000100:00100000:2.0:1789302199.384436:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121459712 00000100:00100000:2.0:1789302199.384513:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789302199.384525:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121459712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302199.384567:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789302199.384643:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121459712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302199.384650:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789302199.386790:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121459712:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789302199.702623:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302200.725428:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302201.760055:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302201.940949:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302201.940978:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121459840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789302201.941083:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302201.941191:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121459840 00000100:00100000:2.0:1789302201.941202:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121459840 00000100:00100000:2.0:1789302201.941274:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789302201.941289:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121459840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789302201.941497:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302201.941556:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121459840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 273us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302201.941564:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789302201.941589:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302201.941624:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383457800 x1876219121459840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302201.941651:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121459840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302201.941847:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121459968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302201.941887:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302201.941946:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121459968 00000100:00100000:2.0:1789302201.941951:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121459968 00000100:00100000:2.0:1789302201.941979:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789302201.941985:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121459968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302201.941995:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302201.946601:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121459968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4597us (4695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302201.946620:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1789302201.946675:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302201.946884:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eec380 x1876219121459968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302201.946916:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121459968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789302202.773632:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302203.476912:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121460096:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477010:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477069:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121460608:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477096:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477133:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121461120:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477157:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477174:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121461632:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477191:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477216:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789302203.477221:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121460480:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477243:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477259:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121460992:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477276:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477299:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121461504:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477333:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477363:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121460224:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477383:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477399:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121460736:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477416:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477430:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121461248:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477447:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477463:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789302203.477468:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121460352:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477493:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477508:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121460864:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477525:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477539:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121461376:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477555:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302203.477583:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121460096 00000100:00100000:1.0:1789302203.477593:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121460096 00000100:00100000:1.0:1789302203.477644:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789302203.477653:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121460096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477708:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121460096:12345-0@lo:400:kworker.0 Request processed in 56us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302203.477716:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789302203.477760:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121460608 00000100:00100000:1.0:1789302203.477763:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121460608 00000100:00100000:1.0:1789302203.477797:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121460352 00000100:00100000:1.0:1789302203.477800:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121460352 00000100:00100000:1.0:1789302203.477821:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789302203.477827:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121460608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477859:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121460608:12345-0@lo:400:kworker.0 Request processed in 33us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302203.477865:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789302203.477876:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789302203.477880:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc491340c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121460352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.477905:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc491340c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121460352:12345-0@lo:400:kworker.0 Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302203.477911:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789302203.480625:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121461120 00000100:00100000:1.0:1789302203.480644:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121461120 00000100:00100000:1.0:1789302203.480958:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121461632 00000100:00100000:1.0:1789302203.480963:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121461632 00000100:00080000:3.0:1789302203.482452:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789302203.482465:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302203.483279:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121460992 00000100:00100000:1.0:1789302203.483293:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121460992 00000100:00100000:0.0:1789302203.483509:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121460480 00000100:00100000:0.0:1789302203.483514:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121460480 00000100:00100000:0.0:1789302203.483542:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121460224 00000100:00100000:0.0:1789302203.483544:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121460224 00000100:00100000:0.0:1789302203.483554:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121460736 00000100:00100000:0.0:1789302203.483557:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121460736 00000100:00100000:0.0:1789302203.483570:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121461248 00000100:00100000:0.0:1789302203.483572:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121461248 00000100:00100000:0.0:1789302203.483583:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121460864 00000100:00100000:0.0:1789302203.483585:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121460864 00000100:00100000:0.0:1789302203.483615:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121461376 00000100:00100000:0.0:1789302203.483618:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121461376 00000100:00100000:0.0:1789302203.483638:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789302203.483648:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121460480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.483798:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121460480:12345-0@lo:400:kworker.0 Request processed in 151us (6552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302203.483806:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789302203.483825:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789302203.483831:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121460224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.483857:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121460224:12345-0@lo:400:kworker.0 Request processed in 27us (6472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302203.483863:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789302203.483872:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789302203.483877:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121460736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.483899:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121460736:12345-0@lo:400:kworker.0 Request processed in 22us (6482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302203.483904:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789302203.483913:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789302203.483918:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121461248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.483939:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121461248:12345-0@lo:400:kworker.0 Request processed in 22us (6492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302203.483945:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789302203.483953:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789302203.483958:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121460864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.483980:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121460864:12345-0@lo:400:kworker.0 Request processed in 22us (6454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302203.483991:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789302203.484001:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789302203.484006:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121461376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.484031:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121461376:12345-0@lo:400:kworker.0 Request processed in 25us (6475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302203.484036:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789302203.484086:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121460480:0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.484099:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121460096:0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.484133:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121460608:0@lo:400:kworker.0 00000100:00100000:2.0:1789302203.484363:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121461504 00000100:00100000:2.0:1789302203.484368:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121461504 00000100:00100000:2.0:1789302203.484400:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789302203.484459:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789302203.484467:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121461632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.484519:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121461632:12345-0@lo:400:kworker.0 Request processed in 52us (7326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302203.484525:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789302203.484546:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789302203.484552:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121461504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.484575:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121461504:12345-0@lo:400:kworker.0 Request processed in 25us (7243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302203.484581:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789302203.484591:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1789302203.484652:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f19500 x1876219121461504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302203.484665:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121461504:0@lo:400:kworker.0 00010000:00080000:0.0:1789302203.484677:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f1a300 x1876219121461632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302203.484685:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121461632:0@lo:400:kworker.0 00000100:00080000:3.0:1789302203.484888:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302203.484948:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121461120:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789302203.485604:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f18e00 x1876219121461120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302203.485617:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121461120:0@lo:400:kworker.0 00000100:00100000:2.0:1789302203.485692:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121461120:12345-0@lo:400:kworker.0 Request processed in 595us (7845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302203.485704:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789302203.490459:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121460992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.491951:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121460992:12345-0@lo:400:kworker.0 Request processed in 7337us (14662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302203.491967:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789302203.492109:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302203.492150:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121461760:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1789302203.493435:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789302203.493445:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789302203.493449:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789302203.493624:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f0ad80 x1876219121460992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302203.493648:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121460992:0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.494512:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121460352:0@lo:400:kworker.0 00010000:00080000:0.0:1789302203.494530:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383be7800 x1876219121460864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302203.494540:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121460864:0@lo:400:kworker.0 00010000:00080000:0.0:1789302203.494563:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f1bb80 x1876219121461376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302203.494573:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121461376:0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.494586:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121460224:0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.494930:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121460736:0@lo:400:kworker.0 00000100:00100000:0.0:1789302203.494944:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121461248:0@lo:400:kworker.0 00000100:00100000:1.0:1789302203.500720:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302203.503263:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121461760 00000100:00100000:2.0:1789302203.503283:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121461760 00000100:00100000:2.0:1789302203.503374:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789302203.503386:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121461760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302203.503435:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789302203.503541:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121461760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302203.503549:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789302203.503637:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121461760:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789302203.800913:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302203.990075:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121462016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302203.990221:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302203.990375:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121462016 00000100:00100000:0.0:1789302203.990383:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121462016 00000100:00100000:0.0:1789302203.990443:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789302203.990453:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121462016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302203.990480:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302203.990514:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121461888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302203.990521:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121462016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302203.990528:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789302203.990539:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302203.990551:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121461888 00000100:00100000:0.0:1789302203.990554:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121461888 00000100:00100000:0.0:1789302203.990569:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789302203.990574:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121461888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302203.990600:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302203.990646:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121461888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302203.990652:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1789302203.990862:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef8e00 x1876219121461888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302203.990879:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121461888:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789302203.995246:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f18a80 x1876219121462016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302203.995274:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121462016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302204.500382:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302204.500406:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121462144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302204.500474:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302204.500589:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121462144 00000100:00100000:2.0:1789302204.500597:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121462144 00000100:00100000:2.0:1789302204.500714:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789302204.500725:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121462144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302204.500757:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789302204.500811:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121462144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302204.500922:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121462144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302204.500976:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789302204.756208:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302204.756294:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302204.756330:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302204.756487:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101460864 00000100:00100000:2.0:1789302204.756499:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101460864 00000100:00100000:2.0:1789302204.756564:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 308 00000100:00100000:2.0:1789302204.756576:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48534b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101460864:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302204.756665:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48534b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101460864:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 91us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302204.756685:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 308 00000100:00100000:3.0:1789302204.757462:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302204.757484:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302204.757525:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101461632 00000100:00100000:2.0:1789302204.757531:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101461632 00000100:00100000:2.0:1789302204.757583:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 68 00000100:00100000:2.0:1789302204.757593:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fadf847f-5c0c-4967-b509-d18868692ac4+6:2399:x1876219101461632:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302204.757641:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384081c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fadf847f-5c0c-4967-b509-d18868692ac4+6:2399:x1876219101461632:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302204.757663:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 68 00000100:00080000:2.0:1789302204.757699:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302204.762182:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302204.764202:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101461120 00000100:00100000:1.0:1789302204.764221:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101461120 00000100:00100000:1.0:1789302204.764341:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101461376 00000100:00100000:1.0:1789302204.764345:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101461376 00000100:00100000:1.0:1789302204.764367:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101460992 00000100:00100000:1.0:1789302204.764370:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101460992 00000100:00100000:1.0:1789302204.764398:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 151 00000100:00100000:1.0:1789302204.764409:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101461120:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302204.764796:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 152 00000100:00100000:2.0:1789302204.764813:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+6:2399:x1876219101461376:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302204.764906:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+6:2399:x1876219101461376:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 90us (8564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302204.764914:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 152 00000100:00100000:2.0:1789302204.764956:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 153 00000100:00100000:2.0:1789302204.764963:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101460992:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302204.764986:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101460992:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (7503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302204.764992:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 153 00000100:00080000:2.0:1789302204.765868:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302204.765876:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789302204.766055:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101461120:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 1644us (9757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302204.766066:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 151 00000100:00100000:3.0:1789302204.773757:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302204.776160:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101461504 00000100:00100000:0.0:1789302204.776180:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101461504 00000100:00100000:0.0:1789302204.776283:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 69 00000100:00100000:0.0:1789302204.776295:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fadf847f-5c0c-4967-b509-d18868692ac4+6:2399:x1876219101461504:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302204.776392:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fadf847f-5c0c-4967-b509-d18868692ac4+6:2399:x1876219101461504:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 99us (2648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302204.776411:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 69 00000100:00080000:3.0:1789302204.777194:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302204.781621:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101461248 00000100:00100000:2.0:1789302204.781639:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101461248 00000100:00100000:2.0:1789302204.781778:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 154 00000100:00100000:2.0:1789302204.781793:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+6:2399:x1876219101461248:12345-192.168.203.9@tcp:400:kworker.0 00000100:00080000:3.0:1789302204.782569:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302204.782828:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+6:2399:x1876219101461248:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 1036us (20658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302204.782839:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 154 00010000:00010000:2.0:1789302204.820389:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789302205.015945:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fadf847f-5c0c-4967-b509-d18868692ac4 00000001:00100000:0.0:1789302205.016579:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fadf847f-5c0c-4967-b509-d18868692ac4 00000001:00100000:1.0:1789302205.018424:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fadf847f-5c0c-4967-b509-d18868692ac4 00000001:00100000:2.0:1789302205.022564:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fadf847f-5c0c-4967-b509-d18868692ac4 00010000:00010000:1.0:1789302205.844816:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789302206.135936:0:12200:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1789302206.868652:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302207.060561:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302207.060623:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121462272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302207.060738:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302207.063095:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121462272 00000100:00100000:0.0:1789302207.063128:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121462272 00000100:00100000:0.0:1789302207.063214:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789302207.063229:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b612f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121462272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302207.063271:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302207.063466:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121462400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302207.063538:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302207.064090:0:8448:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789302207.064103:0:8448:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:3.0:1789302207.064259:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302207.065295:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121462400 00000100:00100000:1.0:1789302207.065518:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121462400 00000100:00100000:1.0:1789302207.065577:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789302207.065595:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121462400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302207.065619:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789302207.065684:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302207.065775:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b612f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121462272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2550us (5036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302207.065784:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789302207.066481:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121462400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 893us (2940us total) trans 0 rc 0/0 00010000:00080000:2.0:1789302207.066482:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eef100 x1876219121462272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302207.066490:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789302207.066508:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121462272:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789302207.066537:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eeed80 x1876219121462400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302207.066550:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121462400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789302207.900769:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302208.596373:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121462528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302208.596471:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302208.596560:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121462528 00000100:00100000:1.0:1789302208.596570:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121462528 00000100:00100000:1.0:1789302208.596625:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789302208.596636:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121462528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789302208.596680:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789302208.596730:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121462528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302208.596749:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789302208.596818:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121462528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302208.597233:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121462912:0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.597270:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302208.597293:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121463424:0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.597318:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302208.597342:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121463936:0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.597363:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302208.597382:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789302208.597388:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121462784:0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.597410:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302208.597428:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121463296:0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.597450:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302208.597466:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121463808:0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.597490:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302208.597525:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121462912 00000100:00100000:2.0:1789302208.597530:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121462912 00000100:00100000:2.0:1789302208.597577:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789302208.597593:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121462912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.597635:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121462912:12345-0@lo:400:kworker.0 Request processed in 44us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302208.597642:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789302208.597663:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121463424 00000100:00100000:2.0:1789302208.597667:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121463424 00000100:00100000:2.0:1789302208.597695:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121463936 00000100:00100000:2.0:1789302208.597698:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121463936 00000100:00100000:2.0:1789302208.597724:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789302208.597731:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121463424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.597777:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121463424:12345-0@lo:400:kworker.0 Request processed in 46us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302208.597783:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789302208.597795:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789302208.597801:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121463936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.597828:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121463936:12345-0@lo:400:kworker.0 Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302208.597834:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789302208.597857:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121462784 00000100:00100000:2.0:1789302208.597860:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121462784 00000100:00100000:2.0:1789302208.597883:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121463296 00000100:00100000:2.0:1789302208.597886:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121463296 00000100:00100000:2.0:1789302208.597902:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121463808 00000100:00100000:2.0:1789302208.597905:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121463808 00000100:00100000:2.0:1789302208.597921:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789302208.597927:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121462784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.597957:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121462784:12345-0@lo:400:kworker.0 Request processed in 30us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302208.597970:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789302208.597983:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789302208.597989:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121463296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.598018:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121463296:12345-0@lo:400:kworker.0 Request processed in 30us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302208.598024:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789302208.598035:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789302208.598041:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121463808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.598062:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121463808:12345-0@lo:400:kworker.0 Request processed in 22us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302208.598067:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789302208.598133:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121462784:0@lo:400:kworker.0 00010000:00080000:2.0:1789302208.598146:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eefb80 x1876219121463296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302208.598156:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121463296:0@lo:400:kworker.0 00010000:00080000:2.0:1789302208.598164:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eed880 x1876219121463808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302208.598173:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121463808:0@lo:400:kworker.0 00000100:00100000:2.0:1789302208.598182:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121462912:0@lo:400:kworker.0 00010000:00080000:2.0:1789302208.598190:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eed500 x1876219121463424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302208.598198:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121463424:0@lo:400:kworker.0 00010000:00080000:2.0:1789302208.598215:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eed180 x1876219121463936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302208.598224:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121463936:0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.598411:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121463040:0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.598448:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302208.598475:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121463552:0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.598509:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302208.598534:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121464064:0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.598554:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302208.598574:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789302208.598580:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121462656:0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.598607:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302208.598631:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121463168:0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.598652:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302208.598669:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121463680:0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.598688:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302208.598716:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121462656 00000100:00100000:1.0:1789302208.598721:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121462656 00000100:00100000:1.0:1789302208.598764:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789302208.598771:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121462656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.598807:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121462656:12345-0@lo:400:kworker.0 Request processed in 36us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302208.598814:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789302208.598854:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121463040 00000100:00100000:1.0:1789302208.598858:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121463040 00000100:00100000:1.0:1789302208.598876:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121463168 00000100:00100000:1.0:1789302208.598878:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121463168 00000100:00100000:1.0:1789302208.598893:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121463680 00000100:00100000:1.0:1789302208.598895:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121463680 00000100:00100000:1.0:1789302208.598908:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789302208.598913:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121463040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.598940:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121463040:12345-0@lo:400:kworker.0 Request processed in 27us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302208.598952:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789302208.598964:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789302208.598969:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121463168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.598991:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121463168:12345-0@lo:400:kworker.0 Request processed in 22us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302208.598996:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789302208.599018:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789302208.599024:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121463680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.599045:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121463680:12345-0@lo:400:kworker.0 Request processed in 23us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302208.599051:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789302208.599077:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121463552 00000100:00100000:1.0:1789302208.599081:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121463552 00000100:00100000:1.0:1789302208.599099:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121464064 00000100:00100000:1.0:1789302208.599102:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121464064 00000100:00100000:1.0:1789302208.599148:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789302208.599155:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121463552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.599182:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121463552:12345-0@lo:400:kworker.0 Request processed in 28us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302208.599187:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789302208.599197:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789302208.599202:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121464064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.599226:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121464064:12345-0@lo:400:kworker.0 Request processed in 24us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302208.599231:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789302208.599275:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121462656:0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.599286:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121463168:0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.599294:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121463680:0@lo:400:kworker.0 00000100:00100000:1.0:1789302208.599301:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121463040:0@lo:400:kworker.0 00010000:00080000:1.0:1789302208.599310:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eee300 x1876219121463552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302208.599319:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121463552:0@lo:400:kworker.0 00010000:00080000:1.0:1789302208.599326:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eec000 x1876219121464064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302208.599334:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121464064:0@lo:400:kworker.0 00000100:00080000:3.0:1789302208.599476:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302208.599481:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789302208.599484:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789302208.920272:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302209.108350:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302209.108379:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121464192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302209.108477:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302209.108727:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121464192 00000100:00100000:1.0:1789302209.108747:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121464192 00000100:00100000:1.0:1789302209.108810:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789302209.108822:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121464192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302209.108857:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302209.108975:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121464192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302209.108983:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1789302209.109027:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f19500 x1876219121464192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302209.109046:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121464192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302209.109482:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121464320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302209.109531:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302209.109775:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121464320 00000100:00100000:0.0:1789302209.109781:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121464320 00000100:00100000:0.0:1789302209.109821:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789302209.109842:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121464320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302209.109856:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302209.109964:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121464320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302209.109971:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1789302209.110054:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef8380 x1876219121464320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302209.110070:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121464320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302209.623367:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121464448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302209.623453:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302209.623654:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121464448 00000100:00100000:0.0:1789302209.623663:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121464448 00000100:00100000:0.0:1789302209.623716:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789302209.623735:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121464448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302209.623768:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789302209.625473:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121464448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1743us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302209.625484:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789302209.630431:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121464448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302209.884257:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302209.884295:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302209.884320:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302209.884340:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302209.884360:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302209.884389:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302209.884413:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302209.884440:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101461760 00000100:00100000:2.0:1789302209.884448:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101461760 00000100:00100000:2.0:1789302209.884496:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 310 00000100:00100000:2.0:1789302209.884506:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4883a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101461760:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302209.884576:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4883a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101461760:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 72us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302209.884585:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 310 00000100:00100000:2.0:1789302209.884634:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101462016 00000100:00100000:2.0:1789302209.884638:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101462016 00000100:00100000:2.0:1789302209.884687:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101462272 00000100:00100000:2.0:1789302209.884690:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101462272 00000100:00100000:2.0:1789302209.884704:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101461888 00000100:00100000:2.0:1789302209.884707:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101461888 00000100:00100000:2.0:1789302209.884898:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101462144 00000100:00100000:2.0:1789302209.884902:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101462144 00000100:00100000:2.0:1789302209.884924:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 161 00000100:00100000:2.0:1789302209.884930:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101462016:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302209.884962:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101462016:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 32us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302209.884968:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 161 00000100:00100000:2.0:1789302209.884980:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 162 00000100:00100000:2.0:1789302209.884986:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101462272:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302209.885013:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101462272:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302209.885018:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 162 00000100:00100000:2.0:1789302209.885029:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 163 00000100:00100000:2.0:1789302209.885036:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2396:x1876219101461888:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302209.885059:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2396:x1876219101461888:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302209.885064:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 163 00000100:00100000:2.0:1789302209.885075:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 164 00000100:00100000:2.0:1789302209.885082:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101462144:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302209.885103:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101462144:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302209.885148:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 164 00000100:00100000:2.0:1789302209.885167:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101462528 00000100:00100000:2.0:1789302209.885170:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101462528 00000100:00100000:2.0:1789302209.885199:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101462400 00000100:00100000:2.0:1789302209.885202:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101462400 00000100:00100000:2.0:1789302209.885222:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 74 00000100:00100000:2.0:1789302209.885228:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101462528:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302209.885253:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101462528:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302209.885259:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 74 00000100:00100000:2.0:1789302209.885270:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 75 00000100:00100000:2.0:1789302209.885277:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101462400:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302209.885299:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101462400:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302209.885305:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 75 00000100:00080000:2.0:1789302209.885338:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302209.885342:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302209.885344:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302209.885347:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789302209.940281:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302210.964244:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302211.989517:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302212.180405:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302212.180940:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121464704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302212.181011:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302212.181086:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121464576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302212.181262:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302212.181350:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121464704 00000100:00100000:2.0:1789302212.181358:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121464704 00000100:00100000:2.0:1789302212.181545:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121464576 00000100:00100000:2.0:1789302212.181549:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121464576 00000100:00100000:2.0:1789302212.181572:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789302212.181581:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121464704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789302212.181612:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302212.181824:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121464704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 244us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302212.181832:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789302212.181851:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789302212.181857:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121464576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302212.181866:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302212.181891:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121464576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302212.181897:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1789302212.181934:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f19500 x1876219121464704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302212.181953:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121464704:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789302212.181963:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eef480 x1876219121464576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302212.181973:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121464576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789302212.182272:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789302213.012683:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302213.718724:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121464832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302213.718793:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302213.719027:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121464832 00000100:00100000:3.0:1789302213.719035:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121464832 00000100:00100000:3.0:1789302213.719087:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789302213.719141:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121464832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789302213.719176:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302213.719241:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121464832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302213.719248:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789302213.719562:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121464832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302213.720085:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121465088:0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720156:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302213.720177:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121465600:0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720199:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302213.720216:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121466112:0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720247:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302213.720274:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789302213.720291:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121465216:0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720327:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302213.720346:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121465728:0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720368:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302213.720400:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121466240:0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720420:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302213.720450:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121465088 00000100:00100000:2.0:1789302213.720455:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121465088 00000100:00100000:2.0:1789302213.720486:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121465600 00000100:00100000:2.0:1789302213.720489:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121465600 00000100:00100000:2.0:1789302213.720513:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121466112 00000100:00100000:2.0:1789302213.720516:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121466112 00000100:00100000:2.0:1789302213.720536:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789302213.720543:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121465088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720596:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121465088:12345-0@lo:400:kworker.0 Request processed in 52us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302213.720602:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789302213.720617:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789302213.720622:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121465600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720649:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121465600:12345-0@lo:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302213.720654:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789302213.720665:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789302213.720671:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121466112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720695:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121466112:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302213.720712:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789302213.720745:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121465216 00000100:00100000:2.0:1789302213.720749:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121465216 00000100:00100000:2.0:1789302213.720767:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789302213.720772:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121465216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720801:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121465216:12345-0@lo:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302213.720806:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789302213.720820:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121465728 00000100:00100000:2.0:1789302213.720823:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121465728 00000100:00100000:2.0:1789302213.720841:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121466240 00000100:00100000:2.0:1789302213.720843:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121466240 00000100:00100000:2.0:1789302213.720862:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789302213.720868:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121465728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720897:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121465728:12345-0@lo:400:kworker.0 Request processed in 29us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302213.720903:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789302213.720914:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789302213.720920:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121466240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.720945:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121466240:12345-0@lo:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302213.720960:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789302213.721005:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121465216:0@lo:400:kworker.0 00010000:00080000:2.0:1789302213.721018:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5283b80 x1876219121465728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302213.721027:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121465728:0@lo:400:kworker.0 00010000:00080000:2.0:1789302213.721036:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5283100 x1876219121466240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302213.721052:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121466240:0@lo:400:kworker.0 00000100:00100000:2.0:1789302213.721066:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121465088:0@lo:400:kworker.0 00010000:00080000:2.0:1789302213.721075:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5281180 x1876219121465600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302213.721083:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121465600:0@lo:400:kworker.0 00010000:00080000:2.0:1789302213.721091:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5283480 x1876219121466112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302213.721098:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121466112:0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.721652:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121465344:0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.721694:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302213.721731:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121465856:0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.721753:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302213.721770:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121466368:0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.721786:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302213.721802:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789302213.721807:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121464960:0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.721830:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302213.721861:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121465472:0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.721881:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302213.721893:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121465984:0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.721910:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302213.721936:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121465344 00000100:00100000:0.0:1789302213.721941:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121465344 00000100:00100000:0.0:1789302213.721977:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121465472 00000100:00100000:0.0:1789302213.721980:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121465472 00000100:00100000:0.0:1789302213.721992:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121465984 00000100:00100000:0.0:1789302213.721994:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121465984 00000100:00100000:0.0:1789302213.722007:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789302213.722013:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121465344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.722049:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121465344:12345-0@lo:400:kworker.0 Request processed in 36us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302213.722055:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789302213.722069:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789302213.722074:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121465472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.722096:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121465472:12345-0@lo:400:kworker.0 Request processed in 23us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302213.722102:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789302213.722132:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789302213.722138:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121465984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.722160:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121465984:12345-0@lo:400:kworker.0 Request processed in 23us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302213.722165:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789302213.722181:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121465856 00000100:00100000:0.0:1789302213.722184:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121465856 00000100:00100000:0.0:1789302213.722207:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121466368 00000100:00100000:0.0:1789302213.722210:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121466368 00000100:00100000:0.0:1789302213.722227:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789302213.722243:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121465856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.722273:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121465856:12345-0@lo:400:kworker.0 Request processed in 41us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302213.722289:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789302213.722300:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789302213.722305:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121466368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.722330:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121466368:12345-0@lo:400:kworker.0 Request processed in 25us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302213.722335:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789302213.722366:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121465472:0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.722375:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121465984:0@lo:400:kworker.0 00000100:00100000:0.0:1789302213.722689:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121465344:0@lo:400:kworker.0 00010000:00080000:0.0:1789302213.722714:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5280a80 x1876219121465856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302213.722724:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121465856:0@lo:400:kworker.0 00010000:00080000:0.0:1789302213.722733:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5280e00 x1876219121466368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302213.722739:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121466368:0@lo:400:kworker.0 00000100:00100000:1.0:1789302213.722838:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121464960 00000100:00100000:1.0:1789302213.722842:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121464960 00000100:00100000:1.0:1789302213.722883:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789302213.722890:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4883a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121464960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302213.722928:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4883a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121464960:12345-0@lo:400:kworker.0 Request processed in 39us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302213.722934:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789302213.722983:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121464960:0@lo:400:kworker.0 00000100:00080000:3.0:1789302213.724483:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302213.724492:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789302213.724495:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789302214.040853:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302214.228611:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302214.228635:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121466496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302214.228710:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302214.228769:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121466496 00000100:00100000:2.0:1789302214.228776:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121466496 00000100:00100000:2.0:1789302214.228813:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789302214.228821:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121466496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302214.228849:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302214.228892:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121466496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302214.228899:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1789302214.228937:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5280e00 x1876219121466496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302214.228956:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121466496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302214.230731:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302214.230750:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121466624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302214.230804:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302214.230937:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121466624 00000100:00100000:1.0:1789302214.230944:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121466624 00000100:00100000:1.0:1789302214.230996:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789302214.231006:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121466624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302214.231028:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302214.231072:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121466624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302214.231079:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1789302214.231149:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5280a80 x1876219121466624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302214.231168:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121466624:0@lo:13:osp-pre-1-1.0 00000020:00000004:0.0:1789302214.717816:0:12517:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302214.718286:0:12517:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789302214.764002:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302214.764024:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121466752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302214.764088:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302214.768701:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121466752 00000100:00100000:1.0:1789302214.768716:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121466752 00000100:00100000:1.0:1789302214.768795:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789302214.768806:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121466752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789302214.768853:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789302214.768935:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121466752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (4846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302214.768943:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789302214.769010:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121466752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302215.013268:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302215.013306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302215.013331:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302215.013352:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302215.013392:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302215.013415:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302215.013438:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302215.013463:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101462912 00000100:00100000:3.0:1789302215.013472:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101462912 00000100:00100000:3.0:1789302215.013522:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101463168 00000100:00100000:3.0:1789302215.013525:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101463168 00000100:00100000:3.0:1789302215.013542:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101462784 00000100:00100000:3.0:1789302215.013545:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101462784 00000100:00100000:3.0:1789302215.013555:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101463040 00000100:00100000:3.0:1789302215.013557:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101463040 00000100:00100000:3.0:1789302215.013571:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 171 00000100:00100000:3.0:1789302215.013580:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101462912:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302215.013652:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101462912:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 72us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302215.013659:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 171 00000100:00100000:3.0:1789302215.013686:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 172 00000100:00100000:3.0:1789302215.013703:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101463168:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302215.013730:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101463168:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 38us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302215.013736:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 172 00000100:00100000:3.0:1789302215.013748:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 173 00000100:00100000:3.0:1789302215.013754:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101462784:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302215.013776:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101462784:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302215.013782:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 173 00000100:00100000:3.0:1789302215.013793:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 174 00000100:00100000:3.0:1789302215.013799:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101463040:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302215.013818:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101463040:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 20us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302215.013824:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 174 00000100:00100000:3.0:1789302215.013842:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101463424 00000100:00100000:3.0:1789302215.013845:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101463424 00000100:00100000:3.0:1789302215.013871:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101463296 00000100:00100000:3.0:1789302215.013873:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101463296 00000100:00100000:3.0:1789302215.013893:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 80 00000100:00100000:3.0:1789302215.013899:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101463424:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302215.013923:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101463424:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302215.013929:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 80 00000100:00100000:3.0:1789302215.013939:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 81 00000100:00100000:3.0:1789302215.013951:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101463296:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302215.016595:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101462656 00000100:00100000:0.0:1789302215.016619:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101462656 00000100:00100000:0.0:1789302215.016683:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 312 00000100:00100000:0.0:1789302215.016701:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101462656:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302215.016816:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101463296:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 2862us (3374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302215.016826:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 81 00000100:00080000:3.0:1789302215.016867:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789302215.016871:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789302215.016875:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302215.016877:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789302215.019817:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101462656:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3116us (6549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302215.019833:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 312 00010000:00010000:3.0:1789302215.061901:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302216.090739:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789302217.019048:0:12615:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789302217.019365:0:12615:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789302217.109368:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302217.301250:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121467008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302217.301322:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302217.301381:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302217.301398:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121466880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302217.301421:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302217.301515:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121467008 00000100:00100000:0.0:1789302217.301524:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121467008 00000100:00100000:0.0:1789302217.301577:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121466880 00000100:00100000:0.0:1789302217.301580:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121466880 00000100:00100000:0.0:1789302217.301605:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789302217.301612:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121467008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302217.301639:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302217.301690:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121467008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302217.301697:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789302217.301712:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789302217.301718:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121466880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302217.301727:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302217.301746:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121466880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 29us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302217.301752:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789302217.301949:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789302217.301977:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eef100 x1876219121466880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302217.301994:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121466880:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789302217.302004:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef8e00 x1876219121467008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302217.302015:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121467008:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789302218.140198:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302218.837496:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121467136:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.837567:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.837624:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121467648:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.837652:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.837681:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121468160:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.837720:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.838144:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121468672:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.838172:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.838201:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789302218.838208:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121467264:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.838231:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.838253:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121467776:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.838284:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.838304:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121468288:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.838329:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.838364:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121467392:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.838385:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.838403:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121467904:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.838423:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.838439:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121468416:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.838457:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.838475:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789302218.838482:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121467520:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.838502:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.838512:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121468032:0@lo:400:kworker.0 00000100:00100000:2.0:1789302218.838521:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121467264 00000100:00100000:2.0:1789302218.838529:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121467264 00000100:00100000:1.0:1789302218.838530:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302218.838543:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121468544:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.838559:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302218.838568:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121467776 00000100:00100000:2.0:1789302218.838571:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121467776 00000100:00100000:2.0:1789302218.838596:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121468288 00000100:00100000:2.0:1789302218.838599:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121468288 00000100:00100000:1.0:1789302218.838599:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121467136 00000100:00100000:2.0:1789302218.838611:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121467904 00000100:00100000:1.0:1789302218.838611:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121467136 00000100:00100000:2.0:1789302218.838613:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121467904 00000100:00100000:2.0:1789302218.838622:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121468416 00000100:00100000:2.0:1789302218.838623:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121468416 00000100:00100000:2.0:1789302218.838634:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121467520 00000100:00100000:2.0:1789302218.838636:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121467520 00000100:00100000:1.0:1789302218.838637:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789302218.838645:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121467136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302218.838647:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789302218.838652:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121467264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302218.838768:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121468160 00000100:00100000:0.0:1789302218.838772:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121468160 00000100:00100000:2.0:1789302218.838780:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121467264:12345-0@lo:400:kworker.0 Request processed in 127us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302218.838787:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789302218.838791:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121468672 00000100:00100000:0.0:1789302218.838794:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121468672 00000100:00100000:2.0:1789302218.838803:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789302218.838809:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121467776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302218.838813:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121468032 00000100:00100000:0.0:1789302218.838816:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121468032 00000100:00100000:0.0:1789302218.838839:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121468544 00000100:00100000:0.0:1789302218.838842:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121468544 00000100:00100000:0.0:1789302218.838860:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789302218.838866:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121468160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.839234:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121467136:12345-0@lo:400:kworker.0 Request processed in 587us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302218.839242:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789302218.839338:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121467648 00000100:00100000:1.0:1789302218.839343:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121467648 00000100:00100000:1.0:1789302218.839372:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121467392 00000100:00100000:1.0:1789302218.839375:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121467392 00000100:00100000:1.0:1789302218.839389:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789302218.839395:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121467648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.839430:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121467648:12345-0@lo:400:kworker.0 Request processed in 35us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302218.839436:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789302218.839448:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789302218.839453:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121467392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.839483:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121467392:12345-0@lo:400:kworker.0 Request processed in 30us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302218.839488:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789302218.839507:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789302218.839515:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121468672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.839544:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121468672:12345-0@lo:400:kworker.0 Request processed in 30us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302218.839550:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789302218.839562:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789302218.839567:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121468032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.839764:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121468032:12345-0@lo:400:kworker.0 Request processed in 196us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302218.839770:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789302218.839783:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789302218.839789:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121468544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.841161:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121468544:12345-0@lo:400:kworker.0 Request processed in 30us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302218.841173:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789302218.841215:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789302218.841228:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121468288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.841351:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121468288:12345-0@lo:400:kworker.0 Request processed in 128us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302218.841358:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789302218.841375:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789302218.841382:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121467904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.841410:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121467904:12345-0@lo:400:kworker.0 Request processed in 29us (2986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302218.841416:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789302218.841427:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789302218.841433:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121468416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.841458:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121468416:12345-0@lo:400:kworker.0 Request processed in 26us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302218.841463:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789302218.841475:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789302218.841482:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121467520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.841520:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121467520:12345-0@lo:400:kworker.0 Request processed in 39us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302218.841526:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:1.0:1789302218.841562:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302218.841567:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789302218.841570:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302218.845766:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121468800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302218.845852:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302218.845907:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121468800 00000100:00100000:3.0:1789302218.845913:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121468800 00000100:00100000:3.0:1789302218.845953:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789302218.845962:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121468800:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302218.845980:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121467520:0@lo:400:kworker.0 00000004:00000024:3.0:1789302218.845995:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00010000:00080000:1.0:1789302218.846000:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5280e00 x1876219121468032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302218.846010:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121468032:0@lo:400:kworker.0 00010000:00080000:1.0:1789302218.846022:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e60380 x1876219121468544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302218.846030:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121468544:0@lo:400:kworker.0 00000100:00100000:3.0:1789302218.846036:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121468800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302218.846041:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121467392:0@lo:400:kworker.0 00000100:00100000:3.0:1789302218.846042:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:1.0:1789302218.846051:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5281880 x1876219121467904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302218.846059:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121467904:0@lo:400:kworker.0 00010000:00080000:1.0:1789302218.846070:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e61f80 x1876219121468416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302218.846074:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121468800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302218.846078:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121468416:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.847998:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121467264:0@lo:400:kworker.0 00000100:00100000:2.0:1789302218.852086:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121467776:12345-0@lo:400:kworker.0 Request processed in 13266us (13790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302218.852102:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789302218.855463:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121468160:12345-0@lo:400:kworker.0 Request processed in 16587us (17732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302218.855479:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789302218.856163:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121467776:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.856193:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121468288:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.856205:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121467136:0@lo:400:kworker.0 00000100:00100000:1.0:1789302218.856217:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121467648:0@lo:400:kworker.0 00010000:00080000:1.0:1789302218.856230:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f19500 x1876219121468160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302218.856241:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121468160:0@lo:400:kworker.0 00010000:00080000:1.0:1789302218.856252:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc382916680 x1876219121468672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302218.856416:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121468672:0@lo:400:kworker.0 00010000:00010000:2.0:1789302219.156362:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789302219.318957:0:12712:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302219.319358:0:12712:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789302219.348306:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302219.348328:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121468928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302219.348414:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302219.348474:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121468928 00000100:00100000:1.0:1789302219.348481:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121468928 00000100:00100000:1.0:1789302219.348525:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789302219.348534:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121468928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302219.348560:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302219.348610:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121468928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302219.348617:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1789302219.348655:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383441880 x1876219121468928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302219.348684:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121468928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302219.350751:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302219.350770:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121469056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302219.350820:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302219.350868:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121469056 00000100:00100000:1.0:1789302219.350875:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121469056 00000100:00100000:1.0:1789302219.350914:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789302219.350923:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121469056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302219.350943:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302219.350982:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121469056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302219.350989:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1789302219.351020:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383441880 x1876219121469056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302219.351036:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121469056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302219.860461:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302219.860483:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121469184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302219.860544:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302219.860947:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121469184 00000100:00100000:1.0:1789302219.860955:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121469184 00000100:00100000:1.0:1789302219.861003:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789302219.861012:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121469184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789302219.861046:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789302219.861136:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121469184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302219.861144:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789302219.861351:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121469184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789302220.118721:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302220.118767:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302220.118790:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302220.118826:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302220.118855:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302220.118876:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302220.118883:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101463552 00000100:00100000:1.0:1789302220.118892:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101463552 00000100:00100000:0.0:1789302220.118899:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302220.118918:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101464192 00000100:00100000:0.0:1789302220.118921:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101464192 00000100:00100000:1.0:1789302220.118940:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 314 00000100:00100000:1.0:1789302220.118948:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101463552:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302220.118954:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101464320 00000100:00100000:0.0:1789302220.118957:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101464320 00000100:00100000:0.0:1789302220.118974:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:0.0:1789302220.118980:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2395:x1876219101464192:12345-192.168.203.9@tcp:9:kworker.0 00000020:00000080:0.0:1789302220.118999:0:8445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3993e8 00000100:00080000:0.0:1789302220.119007:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cc381fca800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789302220.119025:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101463552:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302220.119032:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 314 00000001:00000004:0.0:1789302220.119045:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789302220.119474:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101463680 00000100:00100000:2.0:1789302220.119478:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101463680 00000100:00100000:2.0:1789302220.119505:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101463808 00000100:00100000:2.0:1789302220.119507:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101463808 00000100:00100000:2.0:1789302220.119517:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101464064 00000100:00100000:2.0:1789302220.119519:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101464064 00000100:00100000:2.0:1789302220.119530:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101463936 00000100:00100000:2.0:1789302220.119532:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101463936 00000100:00100000:2.0:1789302220.119544:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 181 00000100:00100000:2.0:1789302220.119550:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101463680:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302220.119578:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101463680:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302220.119584:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 181 00000100:00100000:2.0:1789302220.119595:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 182 00000100:00100000:2.0:1789302220.119600:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101463808:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302220.119616:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101463808:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 17us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302220.119622:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 182 00000100:00100000:2.0:1789302220.119632:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 183 00000100:00100000:2.0:1789302220.119637:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101464064:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302220.119669:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101464064:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 18us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302220.119675:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 183 00000100:00100000:2.0:1789302220.119687:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 184 00000100:00100000:2.0:1789302220.119693:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101463936:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302220.119727:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101463936:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 35us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302220.119734:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 184 00000100:00100000:0.0:1789302220.119887:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fadf847f-5c0c-4967-b509-d18868692ac4+2:2395:x1876219101464192:12345-192.168.203.9@tcp:9:kworker.0 Request processed in 906us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302220.119902:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:0.0:1789302220.119916:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:0.0:1789302220.119922:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2395:x1876219101464320:12345-192.168.203.9@tcp:9:kworker.0 00000020:00000080:0.0:1789302220.119933:0:8445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3993ef 00000100:00080000:0.0:1789302220.119939:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cc4adef2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789302220.119978:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789302220.120050:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fadf847f-5c0c-4967-b509-d18868692ac4+2:2395:x1876219101464320:12345-192.168.203.9@tcp:9:kworker.0 Request processed in 128us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302220.120057:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00080000:0.0:1789302220.120095:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302220.120105:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302220.120107:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302220.120109:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789302220.120143:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302220.120419:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302220.180202:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302221.205263:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789302221.501890:0:12809:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302221.505510:0:12809:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789302222.241291:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302222.423312:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302222.423334:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121469312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302222.423400:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302222.423467:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121469312 00000100:00100000:1.0:1789302222.423474:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121469312 00000100:00100000:1.0:1789302222.423524:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789302222.423534:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121469312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302222.423559:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302222.423601:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121469312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302222.423608:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1789302222.423658:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383441880 x1876219121469312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302222.423675:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121469312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789302222.423929:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302222.423965:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302222.423976:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121469440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302222.424015:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302222.424096:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121469440 00000100:00100000:0.0:1789302222.424101:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121469440 00000100:00100000:0.0:1789302222.424165:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789302222.424172:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121469440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302222.424184:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302222.424217:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121469440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302222.424223:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789302222.424337:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302222.424358:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384052d80 x1876219121469440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302222.424374:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121469440:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789302223.252487:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789302223.910985:0:12907:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789302223.911246:0:12907:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789302223.960695:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302223.960721:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121469568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302223.960794:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302223.960907:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121469568 00000100:00100000:3.0:1789302223.960916:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121469568 00000100:00100000:3.0:1789302223.961002:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789302223.961012:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121469568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789302223.961045:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302223.961095:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121469568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302223.961102:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789302223.964179:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121469824:0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.964245:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302223.964284:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121470336:0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.964306:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302223.964335:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121470848:0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.964355:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302223.964381:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789302223.964400:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121469696:0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.964429:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302223.964449:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121470208:0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.964469:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302223.964486:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121470720:0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.964504:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302223.964553:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121469824 00000100:00100000:0.0:1789302223.964561:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121469824 00000100:00100000:0.0:1789302223.964595:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121470336 00000100:00100000:0.0:1789302223.964598:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121470336 00000100:00100000:0.0:1789302223.964624:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121470848 00000100:00100000:0.0:1789302223.964638:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121470848 00000100:00100000:0.0:1789302223.964652:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121470208 00000100:00100000:0.0:1789302223.964654:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121470208 00000100:00100000:0.0:1789302223.964664:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121470720 00000100:00100000:0.0:1789302223.964666:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121470720 00000100:00100000:0.0:1789302223.964681:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789302223.964689:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121469824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.964739:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121469824:12345-0@lo:400:kworker.0 Request processed in 50us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302223.964759:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789302223.964777:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789302223.964783:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121470336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.964813:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121470336:12345-0@lo:400:kworker.0 Request processed in 30us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302223.964818:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789302223.964829:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789302223.964836:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121470848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.964863:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121470848:12345-0@lo:400:kworker.0 Request processed in 27us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302223.964868:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789302223.964878:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789302223.964884:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121470208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.964907:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121470208:12345-0@lo:400:kworker.0 Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302223.964913:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789302223.964924:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789302223.964930:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121470720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.964954:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121470720:12345-0@lo:400:kworker.0 Request processed in 25us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302223.964960:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:0.0:1789302223.964981:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302223.964985:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789302223.965010:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121470208:0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.965032:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121470720:0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.965039:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121469824:0@lo:400:kworker.0 00010000:00080000:0.0:1789302223.965048:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5283b80 x1876219121470336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302223.965058:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121470336:0@lo:400:kworker.0 00010000:00080000:0.0:1789302223.965066:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5280e00 x1876219121470848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302223.965073:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121470848:0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966178:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121469952:0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966227:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302223.966260:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121470464:0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966284:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302223.966305:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121470976:0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966337:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302223.966376:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121469568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302223.966405:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789302223.966412:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121470080:0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966438:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302223.966457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121470592:0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966477:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302223.966495:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121471104:0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966513:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302223.966550:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121470464 00000100:00100000:2.0:1789302223.966557:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121470464 00000100:00100000:2.0:1789302223.966588:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121470976 00000100:00100000:2.0:1789302223.966591:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121470976 00000100:00100000:2.0:1789302223.966612:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121470592 00000100:00100000:2.0:1789302223.966615:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121470592 00000100:00100000:2.0:1789302223.966626:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121471104 00000100:00100000:2.0:1789302223.966637:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121471104 00000100:00100000:2.0:1789302223.966653:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789302223.966672:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121470464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966717:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121470464:12345-0@lo:400:kworker.0 Request processed in 47us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302223.966723:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789302223.966739:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789302223.966745:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121470976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966771:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121470976:12345-0@lo:400:kworker.0 Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302223.966776:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789302223.966786:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789302223.966791:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121470592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966813:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121470592:12345-0@lo:400:kworker.0 Request processed in 22us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302223.966818:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789302223.966828:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789302223.966833:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121471104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966857:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121471104:12345-0@lo:400:kworker.0 Request processed in 24us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302223.966863:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1789302223.966887:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302223.966897:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121470080 00000100:00100000:2.0:1789302223.966900:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121470080 00000100:00100000:2.0:1789302223.966925:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789302223.966930:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121470080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302223.966959:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121470080:12345-0@lo:400:kworker.0 Request processed in 28us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302223.966973:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789302223.967005:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121470080:0@lo:400:kworker.0 00010000:00080000:2.0:1789302223.967015:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5281880 x1876219121470592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302223.967025:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121470592:0@lo:400:kworker.0 00010000:00080000:2.0:1789302223.967033:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f77b80 x1876219121471104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302223.967041:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121471104:0@lo:400:kworker.0 00010000:00080000:2.0:1789302223.967048:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5283480 x1876219121470464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302223.967055:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121470464:0@lo:400:kworker.0 00010000:00080000:2.0:1789302223.967061:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5281f80 x1876219121470976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302223.967068:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121470976:0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.968738:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121469952 00000100:00100000:0.0:1789302223.968750:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121469952 00000100:00100000:0.0:1789302223.968805:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789302223.968814:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121469952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302223.968884:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121469952:12345-0@lo:400:kworker.0 Request processed in 71us (2657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302223.968890:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789302223.968988:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121469952:0@lo:400:kworker.0 00000100:00100000:3.0:1789302223.969449:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121469696 00000100:00100000:3.0:1789302223.969454:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121469696 00000100:00100000:3.0:1789302223.969487:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789302223.969495:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121469696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302223.969613:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121469696:12345-0@lo:400:kworker.0 Request processed in 117us (5181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302223.969619:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789302223.971025:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121469696:0@lo:400:kworker.0 00010000:00010000:0.0:1789302224.276464:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302224.468375:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789302224.468407:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121471360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302224.468504:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302224.468589:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121471360 00000100:00100000:0.0:1789302224.468599:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121471360 00000100:00100000:1.0:1789302224.468615:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121471232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302224.468653:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302224.471716:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121471232 00000100:00100000:0.0:1789302224.471739:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121471232 00000100:00100000:0.0:1789302224.471842:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789302224.471856:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121471360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302224.471912:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302224.472620:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121471360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 765us (4113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302224.472642:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789302224.472673:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789302224.472683:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121471232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302224.473013:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302224.473279:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121471232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 597us (4623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302224.473288:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1789302224.473417:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384051c00 x1876219121471360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302224.473444:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121471360:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789302224.473459:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f76680 x1876219121471232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302224.473472:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121471232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302224.980540:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302224.980570:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121471488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789302224.980670:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302224.980763:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121471488 00000100:00100000:0.0:1789302224.980773:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121471488 00000100:00100000:0.0:1789302224.980830:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789302224.980840:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121471488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302224.980884:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789302224.980939:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121471488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302224.980947:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789302224.981004:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121471488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789302225.240107:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302225.240208:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302225.240260:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302225.240286:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302225.240382:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302225.240554:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101464704 00000100:00100000:0.0:1789302225.240567:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101464704 00000100:00100000:0.0:1789302225.240647:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101464960 00000100:00100000:0.0:1789302225.240651:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101464960 00000100:00100000:0.0:1789302225.240667:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101464576 00000100:00100000:0.0:1789302225.240670:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101464576 00000100:00100000:0.0:1789302225.240682:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101464832 00000100:00100000:0.0:1789302225.240685:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101464832 00000100:00100000:0.0:1789302225.240702:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 191 00000100:00100000:0.0:1789302225.240713:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101464704:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302225.240808:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101464704:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 95us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302225.240816:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 191 00000100:00100000:0.0:1789302225.240836:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 192 00000100:00100000:0.0:1789302225.240844:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101464960:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302225.240875:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101464960:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 32us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302225.240879:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101464448 00000100:00100000:0.0:1789302225.240885:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 192 00000100:00100000:3.0:1789302225.240894:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101464448 00000100:00100000:0.0:1789302225.240906:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 193 00000100:00100000:0.0:1789302225.240917:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2396:x1876219101464576:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302225.240952:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2396:x1876219101464576:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 38us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302225.240959:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 193 00000100:00100000:3.0:1789302225.240975:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 316 00000100:00100000:0.0:1789302225.240982:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 194 00000100:00100000:3.0:1789302225.240993:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2397:x1876219101464448:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302225.240997:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101464832:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302225.241037:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101464832:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 45us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302225.241053:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 194 00000100:00100000:3.0:1789302225.241083:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2397:x1876219101464448:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 90us (987us total) trans 0 rc 0/0 00000100:00080000:0.0:1789302225.241090:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302225.241095:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302225.241149:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 316 00010000:00010000:0.0:1789302225.305417:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789302226.010791:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fadf847f-5c0c-4967-b509-d18868692ac4 00000020:00000080:0.0:1789302226.010801:0:9525:0:(genops.c:885:class_export_put()) final put ffff8cc4adef1000/fadf847f-5c0c-4967-b509-d18868692ac4 00000020:00000080:1.0:1789302226.010869:0:486:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4adef1000/fadf847f-5c0c-4967-b509-d18868692ac4 for lustre-OST0001 00000001:00100000:3.0:1789302226.016126:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fadf847f-5c0c-4967-b509-d18868692ac4 00000020:00000080:3.0:1789302226.016135:0:8439:0:(genops.c:885:class_export_put()) final put ffff8cc381fcb800/fadf847f-5c0c-4967-b509-d18868692ac4 00000020:00000080:1.0:1789302226.024914:0:486:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4adef2800 for lustre-OST0001 00000020:00000080:1.0:1789302226.024939:0:486:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc381fcb800/fadf847f-5c0c-4967-b509-d18868692ac4 for lustre-OST0000 00000020:00000080:1.0:1789302226.024991:0:486:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc381fca800 for lustre-OST0000 00010000:00010000:1.0:1789302226.324916:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302227.354072:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302227.540417:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121471616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302227.540489:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302227.540801:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302227.540811:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121471744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302227.540840:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302227.540881:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121471616 00000100:00100000:1.0:1789302227.540889:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121471616 00000100:00100000:2.0:1789302227.541030:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121471744 00000100:00100000:2.0:1789302227.541035:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121471744 00000100:00100000:1.0:1789302227.541094:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789302227.541104:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121471616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302227.541148:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302227.541196:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121471616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302227.541203:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1789302227.541266:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f76680 x1876219121471616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302227.541284:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121471616:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789302227.546314:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302227.550429:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789302227.550446:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121471744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789302227.550475:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302227.550576:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121471744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (9734us total) trans 0 rc 0/0 00010000:00080000:3.0:1789302227.550639:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5283480 x1876219121471744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302227.550660:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121471744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789302227.558036:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:0.0:1789302228.379153:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789302228.405472:0:13051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789302229.076452:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302229.076475:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121471872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302229.076546:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302229.077242:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121471872 00000100:00100000:2.0:1789302229.077251:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121471872 00000100:00100000:2.0:1789302229.077315:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789302229.077325:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121471872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302229.077359:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789302229.077590:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121471872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 265us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302229.077606:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789302229.079701:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121472256:0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.079760:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302229.079792:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121472768:0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.079813:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302229.079832:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121473280:0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.079848:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302229.079866:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789302229.079872:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121472128:0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.079894:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302229.079909:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121472640:0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.079926:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302229.079950:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121473152:0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.080363:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302229.080400:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121472768 00000100:00100000:2.0:1789302229.080421:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121472768 00000100:00100000:2.0:1789302229.080474:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121473280 00000100:00100000:2.0:1789302229.080477:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121473280 00000100:00100000:2.0:1789302229.080497:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789302229.080505:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121472768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.080553:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121472768:12345-0@lo:400:kworker.0 Request processed in 49us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302229.080559:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789302229.080583:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789302229.080590:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121473280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.080624:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121473280:12345-0@lo:400:kworker.0 Request processed in 35us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302229.080630:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1789302229.080676:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd802680 x1876219121472768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302229.080691:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121472768:0@lo:400:kworker.0 00010000:00080000:2.0:1789302229.080702:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd969c00 x1876219121473280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302229.080710:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd969c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121473280:0@lo:400:kworker.0 00000100:00080000:2.0:1789302229.080762:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302229.080768:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302229.081223:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121472256 00000100:00100000:0.0:1789302229.081230:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121472256 00000100:00100000:0.0:1789302229.081274:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789302229.081281:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121472256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302229.081325:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121472256:12345-0@lo:400:kworker.0 Request processed in 45us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302229.081332:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789302229.081351:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121472128 00000100:00100000:0.0:1789302229.081354:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121472128 00000100:00100000:0.0:1789302229.081374:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121472640 00000100:00100000:0.0:1789302229.081377:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121472640 00000100:00100000:0.0:1789302229.081400:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121473152 00000100:00100000:0.0:1789302229.081403:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121473152 00000100:00100000:0.0:1789302229.081417:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789302229.081423:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121472128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302229.081453:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121472128:12345-0@lo:400:kworker.0 Request processed in 29us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302229.081467:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789302229.081480:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789302229.081486:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121472640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302229.081526:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121472640:12345-0@lo:400:kworker.0 Request processed in 41us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302229.081532:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789302229.081544:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789302229.081551:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121473152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302229.081574:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121473152:12345-0@lo:400:kworker.0 Request processed in 24us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302229.081579:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789302229.081622:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121472384:0@lo:400:kworker.0 00000100:00100000:0.0:1789302229.081650:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302229.081678:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121472896:0@lo:400:kworker.0 00000100:00100000:0.0:1789302229.081701:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302229.081719:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121473408:0@lo:400:kworker.0 00000100:00100000:0.0:1789302229.081737:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302229.081756:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789302229.081763:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121472000:0@lo:400:kworker.0 00000100:00100000:0.0:1789302229.081787:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302229.081807:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121472512:0@lo:400:kworker.0 00000100:00100000:0.0:1789302229.081826:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302229.081841:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121473024:0@lo:400:kworker.0 00000100:00100000:0.0:1789302229.081860:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302229.081893:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121472000 00000100:00100000:0.0:1789302229.081897:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121472000 00000100:00100000:0.0:1789302229.081922:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789302229.081941:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121472000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302229.082814:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121471872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302229.083083:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121472896 00000100:00100000:2.0:1789302229.083089:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121472896 00000100:00100000:2.0:1789302229.083144:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121473408 00000100:00100000:2.0:1789302229.083148:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121473408 00000100:00100000:2.0:1789302229.083170:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789302229.083178:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121472896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.083243:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121472896:12345-0@lo:400:kworker.0 Request processed in 66us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302229.083251:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789302229.083283:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789302229.083289:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121473408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.083316:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121473408:12345-0@lo:400:kworker.0 Request processed in 28us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302229.083321:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1789302229.083342:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302229.083346:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302229.083348:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789302229.083356:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121472384 00000100:00100000:2.0:1789302229.083360:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121472384 00000100:00100000:2.0:1789302229.083382:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121472512 00000100:00100000:2.0:1789302229.083385:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121472512 00000100:00100000:2.0:1789302229.083402:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121473024 00000100:00100000:2.0:1789302229.083405:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121473024 00000100:00100000:2.0:1789302229.083416:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789302229.083421:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121472384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.083448:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121472384:12345-0@lo:400:kworker.0 Request processed in 26us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302229.083452:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789302229.083462:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789302229.083468:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121472512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.083491:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121472512:12345-0@lo:400:kworker.0 Request processed in 24us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302229.083496:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789302229.083518:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789302229.083523:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121473024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.083550:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121473024:12345-0@lo:400:kworker.0 Request processed in 27us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302229.083555:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1789302229.083571:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302229.083604:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121472128:0@lo:400:kworker.0 00010000:00080000:2.0:1789302229.083619:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd801880 x1876219121472640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302229.083629:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121472640:0@lo:400:kworker.0 00010000:00080000:2.0:1789302229.083640:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd968a80 x1876219121473152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302229.083648:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121473152:0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.083658:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121472256:0@lo:400:kworker.0 00000100:00100000:0.0:1789302229.089096:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121472000:12345-0@lo:400:kworker.0 Request processed in 7158us (7298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302229.089132:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789302229.091231:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121472000:0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.091252:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121472512:0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.091377:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121473024:0@lo:400:kworker.0 00000100:00100000:2.0:1789302229.091392:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121472384:0@lo:400:kworker.0 00010000:00080000:2.0:1789302229.091406:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd800000 x1876219121472896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302229.091416:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121472896:0@lo:400:kworker.0 00010000:00080000:2.0:1789302229.091451:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd968e00 x1876219121473408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302229.091460:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd968e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121473408:0@lo:400:kworker.0 00010000:00010000:2.0:1789302229.397506:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302229.588929:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302229.588954:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121473536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302229.589022:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302229.589177:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302229.589187:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121473664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302229.589217:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302229.589248:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121473536 00000100:00100000:0.0:1789302229.589255:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121473536 00000100:00100000:0.0:1789302229.589311:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121473664 00000100:00100000:0.0:1789302229.589315:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121473664 00000100:00100000:0.0:1789302229.589330:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789302229.589339:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121473536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302229.589366:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302229.589411:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121473536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302229.589417:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789302229.589434:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789302229.589440:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121473664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302229.589450:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302229.589478:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121473664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302229.589483:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1789302229.589522:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b5283480 x1876219121473664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302229.589554:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121473664:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789302229.589586:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f76680 x1876219121473536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302229.589610:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121473536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302230.101284:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302230.101309:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121473792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302230.101379:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302230.101479:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121473792 00000100:00100000:0.0:1789302230.101487:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121473792 00000100:00100000:0.0:1789302230.101538:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789302230.101549:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121473792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302230.101582:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789302230.101642:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121473792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302230.101650:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789302230.101694:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121473792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302230.359279:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302230.359315:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302230.359339:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302230.359362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302230.359431:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101465216 00000100:00100000:2.0:1789302230.359440:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101465216 00000100:00100000:2.0:1789302230.359491:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101465344 00000100:00100000:2.0:1789302230.359494:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101465344 00000100:00100000:2.0:1789302230.359512:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101465600 00000100:00100000:2.0:1789302230.359515:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101465600 00000100:00100000:2.0:1789302230.359535:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 201 00000100:00100000:2.0:1789302230.359544:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101465216:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302230.359621:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101465216:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 77us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302230.359628:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 201 00000100:00100000:2.0:1789302230.359655:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 202 00000100:00100000:2.0:1789302230.359661:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101465344:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302230.359697:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101465344:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 35us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302230.359702:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 202 00000100:00100000:2.0:1789302230.359716:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 203 00000100:00100000:2.0:1789302230.359723:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101465600:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302230.359746:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101465600:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302230.359751:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 203 00000100:00100000:2.0:1789302230.359774:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101465088 00000100:00100000:2.0:1789302230.359777:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101465088 00000100:00100000:2.0:1789302230.359799:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 318 00000100:00100000:2.0:1789302230.359804:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101465088:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302230.359827:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101465088:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302230.359832:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 318 00000100:00080000:2.0:1789302230.359862:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302230.359866:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302230.361703:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302230.361947:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101465472 00000100:00100000:2.0:1789302230.361955:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101465472 00000100:00080000:3.0:1789302230.362025:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302230.362028:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 204 00000100:00100000:2.0:1789302230.362044:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101465472:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302230.362128:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101465472:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 89us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302230.362136:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 204 00010000:00010000:0.0:1789302230.424343:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302231.445644:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789302232.330709:0:13199:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd680e8a0 20000000:00000080:2.0:1789302232.330733:0:13199:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cc4b7eea400 uarg=0000000000000000 20000000:01000000:2.0:1789302232.330779:0:13199:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789302232.330785:0:13199:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789302232.330789:0:13199:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789302232.331249:0:13200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789302232.331617:0:13199:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789302232.342708:0:13199:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789302232.342739:0:13199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.342757:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4addd2a00/0x1ff82925bd399386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5955 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.342766:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd399394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39938d expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.342772:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4addd2400/0x1ff82925bd3993a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39939b expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.342779:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4addd3a00/0x1ff82925bd3993b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3993a9 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.342785:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b538fe00/0x1ff82925bd3993be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3993b7 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.342792:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd3993d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5994 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.342799:0:13199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.342845:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd3993d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5994 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.342875:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd3993d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5994 expref: 12 pid: 6523 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302232.342891:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121473920:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302232.343002:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b538fe00/0x1ff82925bd3993be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd3993b7 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.343009:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4b538fe00/0x1ff82925bd3993be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd3993b7 expref: 23 pid: 6523 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302232.343017:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121474048:0@lo:104: 00000100:00100000:2.0:1789302232.343053:0:13199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302232.343093:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4addd3a00/0x1ff82925bd3993b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd3993a9 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.343101:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4addd3a00/0x1ff82925bd3993b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd3993a9 expref: 23 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302232.343109:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121474176:0@lo:104: 00000100:00100000:2.0:1789302232.343156:0:13199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302232.343184:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4addd2400/0x1ff82925bd3993a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39939b expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.343191:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4addd2400/0x1ff82925bd3993a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39939b expref: 23 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302232.343199:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121474304:0@lo:104: 00000100:00100000:2.0:1789302232.343219:0:13199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302232.343244:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd399394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39938d expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.343252:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd399394 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39938d expref: 23 pid: 6523 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302232.343259:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd968a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121474432:0@lo:104: 00000100:00100000:2.0:1789302232.343278:0:13199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302232.343611:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121474048 00000100:00100000:1.0:1789302232.343620:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121474048 00000100:00100000:1.0:1789302232.343657:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121474176 00000100:00100000:1.0:1789302232.343661:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121474176 00000100:00100000:1.0:1789302232.343672:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121474304 00000100:00100000:1.0:1789302232.343674:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121474304 00000100:00100000:1.0:1789302232.343682:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121474432 00000100:00100000:1.0:1789302232.343684:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121474432 00000100:00100000:1.0:1789302232.343698:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789302232.343706:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+6:13199:x1876219121474048:12345-0@lo:104: 00010000:00010000:1.0:1789302232.343718:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.343769:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789302232.343775:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+6:13199:x1876219121474048:12345-0@lo:104: Request processed in 69us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302232.343781:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789302232.343798:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789302232.343803:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:13199:x1876219121474176:12345-0@lo:104: 00010000:00010000:1.0:1789302232.343810:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.343845:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789302232.343849:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+5:13199:x1876219121474176:12345-0@lo:104: Request processed in 47us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302232.343855:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789302232.343867:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789302232.343872:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:13199:x1876219121474304:12345-0@lo:104: 00010000:00010000:1.0:1789302232.343879:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.343918:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789302232.343923:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+4:13199:x1876219121474304:12345-0@lo:104: Request processed in 51us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302232.343929:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789302232.343940:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789302232.343945:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd969c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:13199:x1876219121474432:12345-0@lo:104: 00010000:00010000:1.0:1789302232.343951:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.343974:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789302232.343979:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd969c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:483e1a3c-0199-48dd-94ee-f480825c6196+3:13199:x1876219121474432:12345-0@lo:104: Request processed in 34us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302232.343983:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789302232.344002:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789302232.344007:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344014:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2c00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302232.344018:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344026:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302232.344033:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302232.344038:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789302232.344072:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344077:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302232.344095:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344101:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2c00/0x1ff82925bd3993b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3993be expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344135:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789302232.344138:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344143:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3600 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302232.344146:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344152:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302232.344158:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302232.344162:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789302232.344173:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344178:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302232.344183:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344198:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd3993a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3993b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344206:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302232.344209:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344215:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166f400 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302232.344217:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344224:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302232.344230:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302232.344236:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789302232.344246:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344251:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302232.344264:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344270:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48166f400/0x1ff82925bd39939b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd3993a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344278:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302232.344287:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344358:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538fa00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302232.344361:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344367:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302232.344373:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302232.344377:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789302232.344390:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344396:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302232.344402:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344408:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fa00/0x1ff82925bd39938d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399394 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.344419:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302232.344421:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302232.344422:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302232.344429:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302232.344447:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121474560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302232.344474:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302232.344714:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302232.344728:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121474688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302232.344751:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302232.344777:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121474816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302232.344796:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302232.344818:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302232.344823:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121474944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302232.344843:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302232.344872:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121474560 00000100:00100000:1.0:1789302232.344877:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121474560 00010000:00010000:1.0:1789302232.344897:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b538fe00/0x1ff82925bd3993be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3993b7 expref: 24 pid: 6523 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302232.344913:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121474688 00000100:00100000:1.0:1789302232.344916:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121474688 00010000:00010000:1.0:1789302232.344926:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4addd3a00/0x1ff82925bd3993b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3993a9 expref: 25 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302232.344935:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121474816 00000100:00100000:1.0:1789302232.344937:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121474816 00010000:00010000:1.0:1789302232.344946:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4addd2400/0x1ff82925bd3993a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39939b expref: 26 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302232.344955:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121474944 00000100:00100000:1.0:1789302232.344957:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121474944 00010000:00010000:1.0:1789302232.344966:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd399394 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39938d expref: 27 pid: 6523 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302232.344977:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789302232.344983:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+27:3645:x1876219121474560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302232.344994:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302232.345004:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b538fe00/0x1ff82925bd3993be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3993b7 expref: 27 pid: 6523 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.345014:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b538fe00/0x1ff82925bd3993be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd3993b7 expref: 27 pid: 6523 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.345029:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302232.345060:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+27:3645:x1876219121474560:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302232.345066:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789302232.345080:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789302232.345086:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+26:3645:x1876219121474688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302232.345106:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302232.345608:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302232.348547:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4addd2a00/0x1ff82925bd399386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5955 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.348614:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4addd3a00/0x1ff82925bd3993b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3993a9 expref: 26 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.348722:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc4addd2a00/0x1ff82925bd399386 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5955 expref: 12 pid: 6523 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302232.348740:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121475072:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302232.348781:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789302232.348796:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:483e1a3c-0199-48dd-94ee-f480825c6196+26:3647:x1876219121474816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302232.348809:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302232.348815:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4addd2400/0x1ff82925bd3993a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39939b expref: 26 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302232.348904:0:6517:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1789302232.348913:0:6517:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1789302232.348930:0:6516:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1789302232.348939:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789302232.348946:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+26:3647:x1876219121474944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302232.348954:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302232.348958:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd399394 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39938d expref: 26 pid: 6523 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302232.349215:0:13199:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3839ea300 going to sleep for 11 seconds 00010000:00010000:3.0:1789302232.349242:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538fe00/0x1ff82925bd3993be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd3993b7 expref: 26 pid: 6523 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302232.349253:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121474048:0@lo:104: 00000100:00100000:3.0:1789302232.349262:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121474176:0@lo:104: 00000100:00100000:3.0:1789302232.349270:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121474304:0@lo:104: 00000100:00100000:3.0:1789302232.349277:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd968a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121474432:0@lo:104: 00010000:00010000:1.0:1789302232.350602:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4addd3a00/0x1ff82925bd3993b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd3993a9 expref: 25 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.350627:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4addd3a00/0x1ff82925bd3993b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd3993a9 expref: 25 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.350643:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302232.350711:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121474688:12345-0@lo:103:ldlm_bl.0 Request processed in 5624us (5957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302232.350720:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789302232.352193:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121474688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302232.352205:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121474560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302232.353828:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302232.353936:0:6515:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789302232.353947:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101465728 00000100:00100000:1.0:1789302232.353956:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101465728 00010000:00010000:1.0:1789302232.353993:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd3993d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5994 expref: 13 pid: 6523 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302232.354019:0:6515:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789302232.354027:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 44 00000100:00100000:1.0:1789302232.354035:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101465728:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302232.354049:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302232.354055:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd3993d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5994 expref: 13 pid: 6523 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.354069:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd3993d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5994 expref: 13 pid: 6523 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302232.354090:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302232.354161:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101465728:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 125us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302232.354169:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 44 00010000:00010000:3.0:1789302232.355247:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd3993d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5994 expref: 12 pid: 6523 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302232.355277:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121473920:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302232.355291:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1876219121475072:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302232.355354:0:13199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.355510:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4addd2400/0x1ff82925bd3993a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39939b expref: 23 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.355528:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4addd2400/0x1ff82925bd3993a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39939b expref: 23 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.355539:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302232.355606:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:483e1a3c-0199-48dd-94ee-f480825c6196+22:3647:x1876219121474816:12345-0@lo:103:ldlm_bl.0 Request processed in 6815us (10807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302232.355624:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789302232.355867:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121474816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302232.358473:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:0.0:1789302232.358716:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd399394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39938d expref: 21 pid: 6523 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.358741:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd399394 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39938d expref: 21 pid: 6523 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.358756:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302232.358820:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+20:3647:x1876219121474944:12345-0@lo:103:ldlm_bl.0 Request processed in 9873us (13975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302232.358829:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789302232.358858:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101465856 00000100:00100000:0.0:1789302232.358865:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101465856 00010000:00010000:0.0:1789302232.358893:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4addd2a00/0x1ff82925bd399386 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5955 expref: 12 pid: 6523 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302232.358918:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 45 00000100:00100000:0.0:1789302232.358926:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:2399:x1876219101465856:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302232.358938:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302232.358943:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4addd2a00/0x1ff82925bd399386 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5955 expref: 12 pid: 6523 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.358953:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4addd2a00/0x1ff82925bd399386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5955 expref: 12 pid: 6523 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.358963:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4addd2a00/0x1ff82925bd399386 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5955 expref: 12 pid: 6523 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.358974:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.358994:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.359009:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.359015:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.359022:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.359029:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.359035:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348600 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302232.359039:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.359047:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.359063:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302232.359073:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302232.359128:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:2399:x1876219101465856:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 184us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302232.359136:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 45 00000100:00100000:2.0:1789302232.359429:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121474944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302232.359741:0:13199:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302232.359750:0:13199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302232.359756:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd3993f6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302232.472081:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302232.660494:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302232.660517:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121475200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302232.660601:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302232.660724:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121475200 00000100:00100000:0.0:1789302232.660745:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121475200 00000100:00100000:0.0:1789302232.660808:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789302232.660818:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121475200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302232.660848:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302232.660895:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121475200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302232.660903:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1789302232.660962:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302232.661003:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f7c700 x1876219121475200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302232.661020:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121475200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302232.661428:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302232.661439:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121475328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302232.661471:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302232.661545:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121475328 00000100:00100000:2.0:1789302232.661550:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121475328 00000100:00100000:2.0:1789302232.661608:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789302232.661617:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121475328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302232.661629:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302232.661665:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121475328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302232.661671:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1789302232.662824:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f7d880 x1876219121475328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302232.662844:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121475328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789302232.663050:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1789302233.432839:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302233.432861:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc382b0f800 from 7 10000000:01000000:1.0:1789302233.432866:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302233.432936:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302233.432948:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302233.432959:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302233.432993:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121475456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.433091:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302233.433176:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc780 going to sleep for 11 seconds 00000100:00100000:0.0:1789302233.433768:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121475456 00000100:00100000:0.0:1789302233.433776:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121475456 00000100:00100000:0.0:1789302233.433840:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789302233.433850:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121475456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302233.433864:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302233.433880:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd399404 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3993fd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302233.433903:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd399404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3993fd expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302233.433915:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd399404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3993fd expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302233.433923:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538e400, rc 0) 00000100:00100000:0.0:1789302233.433975:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121475456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302233.433981:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789302233.437180:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121475456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302233.437208:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302233.437222:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302233.437306:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121475584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.437361:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302233.437404:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302233.437481:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121475584 00000100:00100000:2.0:1789302233.437488:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121475584 00000100:00100000:2.0:1789302233.437528:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789302233.437537:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121475584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302233.437718:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121475584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302233.437726:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789302233.437795:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121475584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.437823:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121475712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.437873:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302233.437895:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302233.437945:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121475712 00000100:00100000:2.0:1789302233.437949:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121475712 00000100:00100000:2.0:1789302233.437981:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789302233.437987:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121475712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302233.438079:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121475712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302233.438094:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789302233.438238:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121475712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789302233.439153:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789302233.439453:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789302233.439500:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302233.439509:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302233.439520:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302233.439531:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302233.439533:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4adc31000 from 7 10000000:01000000:1.0:1789302233.439536:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302233.439576:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302233.439584:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302233.439594:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302233.439611:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121475840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.439651:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302233.439684:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302233.439737:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121475840 00000100:00100000:2.0:1789302233.439742:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121475840 00000100:00100000:2.0:1789302233.439779:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789302233.439786:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121475840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302233.439795:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302233.439808:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd399412 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39940b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302233.439827:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd399412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39940b expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302233.439836:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd399412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39940b expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302233.439844:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348600, rc 0) 00000100:00100000:2.0:1789302233.439884:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121475840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302233.439891:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789302233.440360:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121475840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302233.440375:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302233.440394:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302233.440444:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121475968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.440468:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302233.440493:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302233.440545:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121475968 00000100:00100000:2.0:1789302233.440549:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121475968 00000100:00100000:2.0:1789302233.440579:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789302233.440585:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121475968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302233.440678:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121475968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302233.440685:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789302233.441431:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121475968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.441462:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.441499:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302233.441526:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302233.444782:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121476096 00000100:00100000:2.0:1789302233.444812:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121476096 00000100:00100000:2.0:1789302233.444879:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789302233.444889:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121476096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302233.445059:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121476096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (3559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302233.445068:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789302233.445806:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789302233.446927:0:13214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789302233.447842:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789302233.447870:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302233.447881:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302233.447894:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302233.447904:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789302233.447906:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b511e800 from 7 10000000:01000000:2.0:1789302233.447909:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789302233.447943:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302233.447950:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302233.447961:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302233.447982:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302233.448035:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302233.448130:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3839ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1789302233.448365:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121476224 00000100:00100000:0.0:1789302233.448372:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121476224 00000100:00100000:0.0:1789302233.448480:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789302233.448496:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121476224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302233.448508:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302233.448519:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538f400/0x1ff82925bd399420 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399419 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302233.448541:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538f400/0x1ff82925bd399420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399419 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302233.448551:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538f400/0x1ff82925bd399420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399419 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302233.448560:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538f400, rc 0) 00000100:00100000:0.0:1789302233.448611:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121476224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302233.448617:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789302233.448754:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302233.448768:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302233.448776:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302233.448826:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.448851:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302233.448931:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302233.449023:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121476352 00000100:00100000:0.0:1789302233.449028:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121476352 00000100:00100000:0.0:1789302233.449043:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789302233.449049:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121476352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302233.449195:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121476352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302233.449201:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789302233.455705:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.455770:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.455858:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302233.455896:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302233.456031:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121476480 00000100:00100000:0.0:1789302233.456038:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121476480 00000100:00100000:0.0:1789302233.456084:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789302233.456092:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121476480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302233.456245:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121476480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302233.456258:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789302233.457161:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789302233.458606:0:13215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789302233.459635:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789302233.459681:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302233.459693:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302233.459705:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302233.459716:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789302233.459718:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b863d000 from 7 10000000:01000000:2.0:1789302233.459721:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789302233.459757:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302233.459765:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302233.459776:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302233.459800:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302233.459862:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302233.459934:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3839ea300 going to sleep for 11 seconds 00000100:00100000:3.0:1789302233.463281:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121476608 00000100:00100000:3.0:1789302233.463297:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121476608 00000100:00100000:3.0:1789302233.463370:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789302233.463382:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121476608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302233.463400:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302233.463420:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39942e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399427 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302233.463448:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39942e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399427 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302233.463473:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39942e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399427 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302233.463482:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178800, rc 0) 00000100:00100000:3.0:1789302233.463573:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121476608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302233.463579:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789302233.463692:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302233.463709:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302233.463719:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302233.463791:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.463826:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302233.463862:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc780 going to sleep for 11 seconds 00000100:00100000:3.0:1789302233.463901:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121476736 00000100:00100000:3.0:1789302233.463906:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121476736 00000100:00100000:3.0:1789302233.463926:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789302233.463933:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121476736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302233.464043:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121476736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302233.464050:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789302233.464103:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.464159:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302233.464198:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302233.464213:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc780 going to sleep for 11 seconds 00000100:00100000:3.0:1789302233.464269:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121476864 00000100:00100000:3.0:1789302233.464273:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121476864 00000100:00100000:3.0:1789302233.464290:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789302233.464295:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121476864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302233.464374:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121476864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302233.464381:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789302233.464449:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121476864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789302233.465452:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789302233.465664:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789302233.465683:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302233.465692:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302233.465703:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302233.492200:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302234.198331:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121477120:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198412:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198462:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121477632:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198483:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198505:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121478144:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198524:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198551:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789302234.198584:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121476992:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198614:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198636:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121477504:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198660:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198678:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121478016:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198703:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198719:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121478528:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198739:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198763:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121477248:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198787:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198809:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121477760:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198827:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198843:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121478272:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198859:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198877:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789302234.198883:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121477376:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198903:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198913:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121477888:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198943:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.198961:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121478400:0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.198982:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.199014:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121477120 00000100:00100000:2.0:1789302234.199020:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121477120 00000100:00100000:2.0:1789302234.199071:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121477632 00000100:00100000:2.0:1789302234.199074:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121477632 00000100:00100000:2.0:1789302234.199094:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121478144 00000100:00100000:2.0:1789302234.199096:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121478144 00000100:00100000:2.0:1789302234.199107:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121477760 00000100:00100000:2.0:1789302234.199129:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121477760 00000100:00100000:2.0:1789302234.199143:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121478272 00000100:00100000:2.0:1789302234.199146:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121478272 00000100:00100000:2.0:1789302234.199157:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121477376 00000100:00100000:2.0:1789302234.199160:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121477376 00000100:00100000:2.0:1789302234.199173:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789302234.199181:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121477120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.199230:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121477120:12345-0@lo:400:kworker.0 Request processed in 49us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302234.199237:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789302234.199253:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789302234.199260:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121477632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302234.199282:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789302234.199285:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121477632:12345-0@lo:400:kworker.0 Request processed in 27us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302234.199291:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121478144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.199291:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789302234.199301:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789302234.199307:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121477760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302234.199323:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121478144:12345-0@lo:400:kworker.0 Request processed in 34us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302234.199330:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121477760:12345-0@lo:400:kworker.0 Request processed in 24us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302234.199339:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789302234.199737:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121477504 00000100:00100000:0.0:1789302234.199742:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121477504 00000100:00100000:0.0:1789302234.199771:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121477248 00000100:00100000:0.0:1789302234.199774:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121477248 00000100:00100000:0.0:1789302234.199788:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789302234.199794:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121477504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302234.199834:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121477504:12345-0@lo:400:kworker.0 Request processed in 40us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302234.199840:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789302234.199855:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789302234.199861:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121477248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302234.199887:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121477248:12345-0@lo:400:kworker.0 Request processed in 26us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302234.199892:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1789302234.199907:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302234.199911:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302234.200077:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789302234.200093:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789302234.200101:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121478272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.200384:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121478272:12345-0@lo:400:kworker.0 Request processed in 284us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302234.200390:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789302234.200404:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789302234.200411:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121477376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302234.200439:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121477376:12345-0@lo:400:kworker.0 Request processed in 29us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302234.200445:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789302234.200468:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121478016 00000100:00100000:2.0:1789302234.200472:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121478016 00000100:00100000:2.0:1789302234.200501:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121478528 00000100:00100000:2.0:1789302234.200504:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121478528 00000100:00100000:2.0:1789302234.200515:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121477888 00000100:00100000:2.0:1789302234.200517:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121477888 00000100:00100000:2.0:1789302234.200528:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121478400 00000100:00100000:2.0:1789302234.200531:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121478400 00000100:00100000:2.0:1789302234.200543:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789302234.200549:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121478016:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789302234.202728:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302234.202738:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302234.203514:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789302234.203531:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121478528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302234.203632:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121478528:12345-0@lo:400:kworker.0 Request processed in 108us (4891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302234.203639:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789302234.203661:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789302234.203668:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121477888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302234.203717:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121477888:12345-0@lo:400:kworker.0 Request processed in 50us (4773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302234.203723:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789302234.203735:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789302234.203742:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121478400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302234.203770:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121478400:12345-0@lo:400:kworker.0 Request processed in 29us (4787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302234.203775:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789302234.203834:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121477376:0@lo:400:kworker.0 00010000:00080000:0.0:1789302234.203850:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd803b80 x1876219121477888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302234.203859:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121477888:0@lo:400:kworker.0 00010000:00080000:0.0:1789302234.203869:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a16680 x1876219121478400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302234.203876:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121478400:0@lo:400:kworker.0 00000100:00100000:0.0:1789302234.203885:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121477248:0@lo:400:kworker.0 00010000:00080000:0.0:1789302234.203895:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd802a00 x1876219121477760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302234.203903:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121477760:0@lo:400:kworker.0 00010000:00080000:0.0:1789302234.203913:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a14a80 x1876219121478272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302234.203919:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121478272:0@lo:400:kworker.0 00000100:00100000:0.0:1789302234.203965:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121478656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302234.204001:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302234.204047:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121477504:0@lo:400:kworker.0 00010000:00080000:0.0:1789302234.204058:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a15500 x1876219121478528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302234.204065:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121478528:0@lo:400:kworker.0 00000100:00100000:0.0:1789302234.204076:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121477120:0@lo:400:kworker.0 00000100:00100000:0.0:1789302234.204086:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121477632:0@lo:400:kworker.0 00000100:00100000:0.0:1789302234.204095:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121478144:0@lo:400:kworker.0 00000100:00100000:3.0:1789302234.204462:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121478656 00000100:00100000:3.0:1789302234.204479:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121478656 00000100:00100000:3.0:1789302234.204515:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789302234.204521:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121478656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789302234.204546:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789302234.204565:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121478016:12345-0@lo:400:kworker.0 Request processed in 4005us (5850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302234.204574:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789302234.204589:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121478656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302234.204595:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789302234.204615:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121476992 00000100:00100000:3.0:1789302234.204618:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121476992 00000100:00100000:3.0:1789302234.204651:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789302234.204657:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121476992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302234.204684:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121476992:12345-0@lo:400:kworker.0 Request processed in 28us (6069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302234.204689:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789302234.209989:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121478656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302234.210012:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121476992:0@lo:400:kworker.0 00010000:00080000:0.0:1789302234.210038:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd800000 x1876219121478016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302234.210049:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121478016:0@lo:400:kworker.0 00000100:00100000:3.0:1789302234.328505:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302234.328533:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101465984 00000100:00100000:3.0:1789302234.328541:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101465984 00000100:00100000:3.0:1789302234.328593:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 332 00000100:00100000:3.0:1789302234.328601:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:6168:x1876219101465984:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302234.328614:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302234.328630:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4c2178c00/0x1ff82925bd399435 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a59c5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302234.328654:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2178c00/0x1ff82925bd399435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59c5 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302234.328676:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4c2178c00/0x1ff82925bd399435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59c5 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302234.328684:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178c00, rc 0) 00000100:00100000:3.0:1789302234.328731:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101465984:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 Request processed in 130us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302234.328737:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 332 00000100:00100000:0.0:1789302234.333957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302234.334045:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101466112 00000100:00100000:3.0:1789302234.334055:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101466112 00000100:00100000:3.0:1789302234.334131:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 333 00000100:00100000:3.0:1789302234.334145:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101466112:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302234.334400:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101466112:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 Request processed in 259us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302234.334409:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 333 00000100:00100000:0.0:1789302234.344395:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302234.344808:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101466240 00000100:00100000:1.0:1789302234.344818:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101466240 00000100:00100000:1.0:1789302234.344885:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 334 00000100:00100000:1.0:1789302234.344895:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101466240:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302234.345039:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101466240:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 Request processed in 145us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302234.345048:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 334 00000100:00100000:0.0:1789302234.354750:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302234.354898:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101466368 00000100:00100000:2.0:1789302234.354907:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101466368 00000100:00100000:2.0:1789302234.354967:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 335 00000100:00100000:2.0:1789302234.354983:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101466368:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302234.355002:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302234.355021:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5348e00/0x1ff82925bd39943c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a59cc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302234.355048:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5348e00/0x1ff82925bd39943c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59cc expref: 13 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302234.355059:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5348e00/0x1ff82925bd39943c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59cc expref: 13 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302234.355067:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348e00, rc 0) 00000100:00100000:2.0:1789302234.355238:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:6168:x1876219101466368:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 Request processed in 256us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302234.355244:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 335 00000100:00100000:2.0:1789302234.369646:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302234.369945:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101466496 00000100:00100000:0.0:1789302234.369956:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101466496 00000100:00100000:0.0:1789302234.370017:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 336 00000100:00100000:0.0:1789302234.370038:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:6168:x1876219101466496:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302234.370243:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:6168:x1876219101466496:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 Request processed in 216us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302234.370251:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 336 00000100:00100000:0.0:1789302234.379363:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302234.381192:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101466624 00000100:00100000:3.0:1789302234.381205:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101466624 00000100:00100000:3.0:1789302234.381271:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 337 00000100:00100000:3.0:1789302234.381283:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:6168:x1876219101466624:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302234.381776:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:6168:x1876219101466624:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 Request processed in 494us (2421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302234.381786:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 337 00010000:00010000:0.0:1789302234.519345:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302234.710728:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302234.710752:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121478784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302234.710820:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.710877:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121478784 00000100:00100000:2.0:1789302234.710886:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121478784 00000100:00100000:2.0:1789302234.710935:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789302234.710943:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121478784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789302234.710967:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302234.711009:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121478784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302234.711016:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1789302234.711064:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4a7f0bb80 x1876219121478784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302234.711083:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121478784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302234.715373:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121478912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302234.715447:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302234.715520:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121478912 00000100:00100000:2.0:1789302234.715529:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121478912 00000100:00100000:2.0:1789302234.715586:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789302234.715596:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121478912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302234.715624:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302234.715669:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121478912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302234.715676:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1789302234.715719:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383806d80 x1876219121478912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302234.715737:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121478912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302235.223338:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302235.223358:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121479040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302235.223418:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302235.223471:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121479040 00000100:00100000:2.0:1789302235.223479:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121479040 00000100:00100000:2.0:1789302235.223523:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789302235.223531:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121479040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302235.223595:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789302235.223648:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121479040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302235.223660:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789302235.223705:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121479040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302235.479175:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302235.479218:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302235.479262:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302235.479288:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302235.479314:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302235.479343:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101466752 00000100:00100000:2.0:1789302235.479352:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101466752 00000100:00100000:2.0:1789302235.479455:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 338 00000100:00100000:2.0:1789302235.479465:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2397:x1876219101466752:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302235.479528:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2397:x1876219101466752:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302235.479535:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 338 00000100:00100000:2.0:1789302235.479578:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101466880 00000100:00100000:2.0:1789302235.479582:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101466880 00000100:00100000:2.0:1789302235.479616:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101467136 00000100:00100000:2.0:1789302235.479619:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101467136 00000100:00100000:2.0:1789302235.479633:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101467008 00000100:00100000:2.0:1789302235.479636:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101467008 00000100:00100000:2.0:1789302235.479648:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101467264 00000100:00100000:2.0:1789302235.479650:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101467264 00000100:00100000:2.0:1789302235.479664:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 211 00000100:00100000:2.0:1789302235.479671:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2397:x1876219101466880:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302235.479701:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2397:x1876219101466880:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 30us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302235.479719:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 211 00000100:00100000:2.0:1789302235.479733:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 212 00000100:00100000:2.0:1789302235.479740:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101467136:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302235.479765:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101467136:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302235.479770:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 212 00000100:00100000:2.0:1789302235.479781:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 213 00000100:00100000:2.0:1789302235.479787:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101467008:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302235.479809:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101467008:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302235.479814:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 213 00000100:00100000:2.0:1789302235.479825:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 214 00000100:00100000:2.0:1789302235.479832:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101467264:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302235.479852:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101467264:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302235.479858:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 214 00000100:00080000:2.0:1789302235.479987:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302235.479991:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789302235.540536:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302236.567390:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789302236.936601:0:13399:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789302237.591515:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302237.780422:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121479168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789302237.780514:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302237.783138:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121479168 00000100:00100000:3.0:1789302237.783228:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121479168 00000100:00100000:3.0:1789302237.783318:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789302237.783343:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121479168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789302237.783374:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302237.783494:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121479168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 154us (2979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302237.783500:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1789302237.783562:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f7ed80 x1876219121479168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302237.783583:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121479168:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789302237.783795:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302237.784457:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302237.784474:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121479296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302237.784526:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302237.784977:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121479296 00000100:00100000:0.0:1789302237.784985:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121479296 00000100:00100000:0.0:1789302237.785045:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789302237.785053:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121479296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302237.785072:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302237.785275:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121479296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302237.785284:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1789302237.785403:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302237.785429:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f7d180 x1876219121479296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302237.785447:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121479296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789302238.612358:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302239.319408:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121479424:0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.319477:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302239.319537:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121479936:0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.319620:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302239.319638:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121480448:0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.319660:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302239.319678:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121480960:0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.319698:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302239.319721:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789302239.319727:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121479808:0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.319749:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302239.319765:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121480320:0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.319783:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302239.319799:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121480832:0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.319818:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302239.319846:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121479424 00000100:00100000:2.0:1789302239.319853:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121479424 00000100:00100000:2.0:1789302239.319900:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789302239.319909:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121479424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.319957:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121479424:12345-0@lo:400:kworker.0 Request processed in 48us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302239.319977:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789302239.320012:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121480448 00000100:00100000:2.0:1789302239.320016:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121480448 00000100:00100000:2.0:1789302239.320042:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121480960 00000100:00100000:2.0:1789302239.320045:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121480960 00000100:00100000:2.0:1789302239.320060:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121480320 00000100:00100000:2.0:1789302239.320062:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121480320 00000100:00100000:2.0:1789302239.320073:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121480832 00000100:00100000:2.0:1789302239.320076:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121480832 00000100:00100000:2.0:1789302239.320089:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789302239.320095:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121480448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.320151:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121480448:12345-0@lo:400:kworker.0 Request processed in 57us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302239.320157:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789302239.320170:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789302239.320176:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121480960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.320202:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121480960:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302239.320207:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789302239.320219:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789302239.320225:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121480320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.320248:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121480320:12345-0@lo:400:kworker.0 Request processed in 24us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302239.320253:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789302239.320264:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789302239.320270:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121480832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.320306:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121480832:12345-0@lo:400:kworker.0 Request processed in 36us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302239.320313:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789302239.320336:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121479808 00000100:00100000:2.0:1789302239.320339:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121479808 00000100:00100000:2.0:1789302239.320363:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789302239.320369:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121479808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.320397:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121479808:12345-0@lo:400:kworker.0 Request processed in 28us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302239.320403:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:2.0:1789302239.320426:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302239.320430:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302239.320575:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121479808:0@lo:400:kworker.0 00010000:00080000:2.0:1789302239.320588:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384082a00 x1876219121480320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302239.320599:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121480320:0@lo:400:kworker.0 00010000:00080000:2.0:1789302239.320609:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384081180 x1876219121480832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302239.320617:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121480832:0@lo:400:kworker.0 00000100:00100000:2.0:1789302239.320625:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121479424:0@lo:400:kworker.0 00010000:00080000:2.0:1789302239.320634:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384083b80 x1876219121480448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302239.320642:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121480448:0@lo:400:kworker.0 00010000:00080000:2.0:1789302239.320650:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384081c00 x1876219121480960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302239.320664:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121480960:0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.322868:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121479552:0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.322932:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302239.322966:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121480064:0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.322988:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302239.323005:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121480576:0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.323024:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302239.323041:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121481088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302239.323076:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302239.323099:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789302239.323104:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121479680:0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.323146:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302239.323164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121480192:0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.323181:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302239.323196:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121480704:0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.323213:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302239.323239:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121479936 00000100:00100000:1.0:1789302239.323246:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121479936 00000100:00100000:1.0:1789302239.323278:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121481088 00000100:00100000:1.0:1789302239.323281:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121481088 00000100:00100000:1.0:1789302239.323291:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121479680 00000100:00100000:1.0:1789302239.323293:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121479680 00000100:00100000:1.0:1789302239.323319:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789302239.323326:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876219121479936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.323378:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876219121479936:12345-0@lo:400:kworker.0 Request processed in 52us (3757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302239.323385:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789302239.323402:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789302239.323407:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121481088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789302239.323429:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789302239.323485:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121481088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302239.323491:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789302239.323505:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789302239.323511:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121479680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.323549:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121479680:12345-0@lo:400:kworker.0 Request processed in 38us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302239.323555:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789302239.323572:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121479552 00000100:00100000:1.0:1789302239.323576:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121479552 00000100:00100000:1.0:1789302239.323593:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121480064 00000100:00100000:1.0:1789302239.323595:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121480064 00000100:00100000:1.0:1789302239.323617:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121480576 00000100:00100000:1.0:1789302239.323620:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121480576 00000100:00100000:1.0:1789302239.323634:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121480192 00000100:00100000:1.0:1789302239.323636:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121480192 00000100:00100000:1.0:1789302239.323648:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121480704 00000100:00100000:1.0:1789302239.323650:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121480704 00000100:00100000:1.0:1789302239.323663:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789302239.323669:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121479552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.323704:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121479552:12345-0@lo:400:kworker.0 Request processed in 35us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302239.323709:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789302239.323721:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789302239.323727:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121480064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.323752:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121480064:12345-0@lo:400:kworker.0 Request processed in 25us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302239.323757:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789302239.323767:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789302239.323773:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121480576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.323798:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121480576:12345-0@lo:400:kworker.0 Request processed in 26us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302239.323804:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789302239.323815:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789302239.323821:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121480192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.323848:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121480192:12345-0@lo:400:kworker.0 Request processed in 27us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302239.323853:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789302239.323866:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789302239.323872:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121480704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.323898:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121480704:12345-0@lo:400:kworker.0 Request processed in 26us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302239.323903:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789302239.323957:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121479936:0@lo:400:kworker.0 00000100:00080000:1.0:1789302239.323989:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789302239.323993:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302239.324009:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121479680:0@lo:400:kworker.0 00010000:00080000:1.0:1789302239.324020:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7e61c00 x1876219121480192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302239.324030:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121480192:0@lo:400:kworker.0 00010000:00080000:1.0:1789302239.324040:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384083480 x1876219121480704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302239.324047:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121480704:0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.324057:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121479552:0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.324065:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121480064:0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.324073:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121480576:0@lo:400:kworker.0 00000100:00100000:1.0:1789302239.324085:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121481088:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789302239.636265:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302239.828668:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121481216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302239.828739:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302239.828909:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302239.828919:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121481344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302239.828948:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302239.828983:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121481216 00000100:00100000:1.0:1789302239.828990:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121481216 00000100:00100000:1.0:1789302239.829026:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121481344 00000100:00100000:1.0:1789302239.829028:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121481344 00000100:00100000:1.0:1789302239.829042:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789302239.829049:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121481216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302239.829091:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302239.829155:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121481216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302239.829162:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789302239.829178:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789302239.829186:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121481344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302239.829195:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302239.829221:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121481344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302239.829226:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1789302239.829257:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383805880 x1876219121481344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302239.829275:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121481344:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789302239.829416:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f1bb80 x1876219121481216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302239.829428:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121481216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302240.340478:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121481472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302240.340562:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302240.340732:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121481472 00000100:00100000:2.0:1789302240.340741:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121481472 00000100:00100000:2.0:1789302240.340792:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789302240.340801:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121481472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302240.340830:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789302240.340889:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121481472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302240.340896:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789302240.341093:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121481472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302240.595214:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302240.595241:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302240.595275:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302240.595294:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302240.595315:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302240.595340:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101467392 00000100:00100000:2.0:1789302240.595349:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101467392 00000100:00100000:2.0:1789302240.595397:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 340 00000100:00100000:2.0:1789302240.595407:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101467392:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302240.595473:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101467392:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302240.595479:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 340 00000100:00100000:0.0:1789302240.595663:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101467520 00000100:00100000:0.0:1789302240.595668:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101467520 00000100:00100000:0.0:1789302240.595714:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101467776 00000100:00100000:0.0:1789302240.595718:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101467776 00000100:00100000:0.0:1789302240.595733:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101467648 00000100:00100000:0.0:1789302240.595736:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101467648 00000100:00100000:0.0:1789302240.595746:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101467904 00000100:00100000:0.0:1789302240.595749:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101467904 00000100:00100000:0.0:1789302240.595764:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 221 00000100:00100000:0.0:1789302240.595770:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2396:x1876219101467520:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302240.595810:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2396:x1876219101467520:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 39us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302240.595833:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 221 00000100:00100000:0.0:1789302240.595847:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 222 00000100:00100000:0.0:1789302240.595865:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101467776:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302240.595892:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101467776:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 39us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302240.595897:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 222 00000100:00100000:0.0:1789302240.595910:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 223 00000100:00100000:0.0:1789302240.595915:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101467648:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302240.595937:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101467648:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302240.595941:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 223 00000100:00100000:0.0:1789302240.595950:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 224 00000100:00100000:0.0:1789302240.595955:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101467904:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302240.595975:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101467904:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 19us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302240.595980:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 224 00000100:00080000:2.0:1789302240.596347:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302240.596351:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789302240.662588:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302241.684454:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789302242.651683:0:13547:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:24:01 (1789302241) === 00010000:00010000:1.0:1789302242.708375:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302242.900461:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121481600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302242.900568:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302242.901684:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121481600 00000100:00100000:2.0:1789302242.901710:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121481600 00000100:00100000:2.0:1789302242.901787:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789302242.901799:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121481600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789302242.901830:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302242.901909:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121481600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302242.901916:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1789302242.901967:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f7fb80 x1876219121481600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302242.901987:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121481600:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789302242.902355:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302242.902432:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121481728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302242.902472:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302242.902692:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121481728 00000100:00100000:0.0:1789302242.902698:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121481728 00000100:00100000:0.0:1789302242.902755:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789302242.902764:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121481728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302242.902778:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302242.902813:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121481728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302242.902828:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1789302242.902935:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302242.903036:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f7d180 x1876219121481728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302242.903051:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121481728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302242.952680:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302242.952730:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302242.952825:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101468160 00000100:00100000:1.0:1789302242.952835:0:6539:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101468160 00000100:00100000:1.0:1789302242.952916:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2 00000100:00100000:1.0:1789302242.952928:0:6539:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c76ee310-c3b4-4286-aaea-77936c269d98+6:10504:x1876219101468160:12345-192.168.203.9@tcp:700:mkdir.0 00000100:00100000:1.0:1789302242.953004:0:6539:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c76ee310-c3b4-4286-aaea-77936c269d98+6:10504:x1876219101468160:12345-192.168.203.9@tcp:700:mkdir.0 Request processed in 79us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302242.953025:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2 00000100:00100000:0.0:1789302242.953410:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101468032 00000100:00100000:0.0:1789302242.953416:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101468032 00000100:00100000:0.0:1789302242.953456:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:0.0:1789302242.953464:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101468032:12345-192.168.203.9@tcp:41:mkdir.0 00000004:00000024:0.0:1789302242.953506:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789302242.953568:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101468032:12345-192.168.203.9@tcp:41:mkdir.0 Request processed in 104us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302242.953575:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00080000:2.0:1789302242.954031:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302242.960476:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302242.960701:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101468416 00000100:00100000:1.0:1789302242.960716:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101468416 00000100:00100000:1.0:1789302242.960796:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:1.0:1789302242.960806:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+6:10504:x1876219101468416:12345-192.168.203.9@tcp:36:mkdir.0 00010000:00010000:1.0:1789302242.960881:0:10111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302242.960951:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd3992e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5940 expref: 6 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.960975:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc38392eb00) 00010000:00010000:1.0:1789302242.960989:0:10111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302242.961065:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399443 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.961078:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399443 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.961087:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399443 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.961109:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.961166:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.961173:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.963409:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.963436:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.963447:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302242.963468:0:10111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd9e7147 reply state 00000000999c75cc transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.963479:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.964905:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc383962600) 00010000:00010000:1.0:1789302242.964916:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789302242.964922:0:10111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789302242.964935:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789302242.964952:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399443 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.964960:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399443 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.964970:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399443 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.964975:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302242.964978:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399443 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.964985:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399443 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.965017:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962100) 00010000:00010000:1.0:1789302242.965019:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302242.965023:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399443 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.965029:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399443 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302242.965055:0:10111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd9e7147 reply state 00000000999c75cc transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.965070:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.965079:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cc383962c00) 00010000:00010000:1.0:1789302242.965082:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789302242.965084:0:10111:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789302242.965237:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+7:10504:x1876219101468416:12345-192.168.203.9@tcp:36:mkdir.0 Request processed in 4426us (4769us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789302242.965245:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:0.0:1789302242.976678:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302242.976777:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101468544 00000100:00100000:1.0:1789302242.976787:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101468544 00000100:00100000:1.0:1789302242.976861:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:1.0:1789302242.976872:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+7:10506:x1876219101468544:12345-192.168.203.9@tcp:101:chmod.0 00010000:00010000:1.0:1789302242.976892:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302242.976912:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a59d3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.976974:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2a00/0x1ff82925bd39945f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.977004:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2a00/0x1ff82925bd39945f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.977017:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2a00/0x1ff82925bd39945f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302242.977058:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789302242.977062:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302242.977096:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2a00/0x1ff82925bd39945f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.977154:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59d3 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.977173:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2a00/0x1ff82925bd39945f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59d3 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.977180:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962100) 00010000:00010000:1.0:1789302242.977183:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302242.977186:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2a00, rc 0) 00000100:00100000:1.0:1789302242.977235:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+8:10506:x1876219101468544:12345-192.168.203.9@tcp:101:chmod.0 Request processed in 366us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302242.977242:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:2.0:1789302242.981530:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302242.981625:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101468800 00000100:00100000:1.0:1789302242.981642:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101468800 00000100:00100000:1.0:1789302242.981729:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:1.0:1789302242.981741:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+8:10506:x1876219101468800:12345-192.168.203.9@tcp:36:chmod.0 00010000:00010000:1.0:1789302242.981789:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302242.981827:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2a00/0x1ff82925bd39945f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59d3 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.981862:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962100) 00010000:00010000:1.0:1789302242.981871:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302242.981895:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.981908:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.981918:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302242.982083:0:9541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f831f25c reply state 00000000a55d8de0 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.982095:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302242.982102:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962300) 00010000:00010000:1.0:1789302242.982104:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789302242.982106:0:9541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789302242.982158:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789302242.982226:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+9:10506:x1876219101468800:12345-192.168.203.9@tcp:36:chmod.0 Request processed in 488us (709us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789302242.982233:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:2.0:1789302243.014695:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302243.014785:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101468928 00000100:00100000:1.0:1789302243.014794:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101468928 00000100:00100000:1.0:1789302243.014861:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 26 00000100:00100000:1.0:1789302243.014870:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+9:10507:x1876219101468928:12345-192.168.203.9@tcp:101:chown.0 00010000:00010000:1.0:1789302243.014907:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302243.014929:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2a00/0x1ff82925bd39946d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a59da expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.014992:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399474 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.015006:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.015017:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302243.015056:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789302243.015059:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302243.015094:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.015157:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2a00/0x1ff82925bd39946d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59da expref: 11 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.015178:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59da expref: 10 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.015187:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962300) 00010000:00010000:1.0:1789302243.015190:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302243.015195:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2000, rc 0) 00000100:00100000:1.0:1789302243.015265:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+10:10507:x1876219101468928:12345-192.168.203.9@tcp:101:chown.0 Request processed in 395us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302243.015273:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 26 00000100:00100000:0.0:1789302243.017350:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302243.019656:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101469056 00000100:00100000:1.0:1789302243.019670:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101469056 00000100:00100000:1.0:1789302243.019738:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 27 00000100:00100000:1.0:1789302243.019748:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+10:10507:x1876219101469056:12345-192.168.203.9@tcp:101:chown.0 00010000:00010000:1.0:1789302243.019767:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302243.019789:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd39947b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a59e1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.019862:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399482 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.019877:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.019889:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.019900:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399489 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.019907:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.019914:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.019997:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399490 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020006:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020040:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302243.020088:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789302243.020092:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302243.020140:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020153:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399482 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020160:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399482 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020167:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399482 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020176:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302243.020181:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399482 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020188:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399482 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020199:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962300) 00010000:00010000:1.0:1789302243.020202:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302243.020207:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399482 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020213:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399482 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020237:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399489 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020243:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399489 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020250:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399489 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020255:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302243.020259:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399489 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020264:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399489 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020273:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cc383962c00) 00010000:00010000:1.0:1789302243.020275:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302243.020278:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399489 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020283:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399489 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020306:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd39947b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59e1 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020318:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399490 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59e1 expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.020334:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc383962600) 00010000:00010000:1.0:1789302243.020336:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302243.020339:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3c00, rc 0) 00000100:00100000:1.0:1789302243.020392:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+11:10507:x1876219101469056:12345-192.168.203.9@tcp:101:chown.0 Request processed in 645us (3049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302243.020399:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 27 00000100:00100000:3.0:1789302243.022883:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302243.024077:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101469184 00000100:00100000:1.0:1789302243.024095:0:6542:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101469184 00000100:00100000:1.0:1789302243.024181:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6 00000100:00100000:1.0:1789302243.024192:0:6542:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c76ee310-c3b4-4286-aaea-77936c269d98+11:10507:x1876219101469184:12345-192.168.203.9@tcp:900:chown.0 00000100:00100000:1.0:1789302243.024287:0:6542:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c76ee310-c3b4-4286-aaea-77936c269d98+11:10507:x1876219101469184:12345-192.168.203.9@tcp:900:chown.0 Request processed in 97us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302243.024295:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6 00000100:00100000:0.0:1789302243.035798:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302243.035963:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101469440 00000100:00100000:3.0:1789302243.035980:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101469440 00000100:00100000:3.0:1789302243.036059:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 28 00000100:00100000:3.0:1789302243.036087:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+11:10507:x1876219101469440:12345-192.168.203.9@tcp:36:chown.0 00010000:00010000:2.0:1789302243.036634:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302243.036672:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399490 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59e1 expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.036696:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc383962600) 00010000:00010000:2.0:1789302243.036701:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302243.036729:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.036744:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.036767:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302243.040136:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1789302243.040252:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5f1ea3d reply state 000000002b142f04 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.040286:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.040297:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc383962600) 00010000:00010000:2.0:1789302243.040300:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789302243.040306:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789302243.040323:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789302243.040421:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040435:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040443:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040449:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302243.040454:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040462:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040480:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cc383962c00) 00010000:00010000:3.0:1789302243.040483:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302243.040488:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040504:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39944a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040596:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040605:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040611:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040628:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302243.040631:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040638:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040647:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc383962600) 00010000:00010000:3.0:1789302243.040650:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302243.040653:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040660:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399451 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040676:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040682:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040688:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040693:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302243.040696:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040702:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1789302243.040720:0:6532:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:3.0:1789302243.040724:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962300) 00010000:00010000:3.0:1789302243.040729:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789302243.040732:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.040738:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399466 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302243.040965:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:10507:x1876219101469440:12345-192.168.203.9@tcp:36:chown.0 Request processed in 4872us (5167us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789302243.040976:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 28 00010000:00010000:1.0:1789302243.043247:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.043267:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.043276:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.043283:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302243.043289:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.043298:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.043338:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc383962600) 00010000:00010000:1.0:1789302243.043341:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789302243.043347:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.043354:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399497 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302243.064692:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302243.064848:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101469568 00000100:00100000:1.0:1789302243.064860:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101469568 00000100:00100000:1.0:1789302243.064940:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00100000:1.0:1789302243.064951:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:10508:x1876219101469568:12345-192.168.203.9@tcp:101:touch.500 00010000:00010000:1.0:1789302243.064982:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302243.065009:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd39949e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a59e8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789302243.080285:0:6531:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 15204us 00010000:00010000:3.0:1789302243.093245:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd3994a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.093277:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd3994a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.093291:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd3994a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.093310:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.093317:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.093323:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.093621:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3994b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.093630:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3994b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.093649:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3994b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302243.093691:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789302243.093695:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302243.093744:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3994b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.093758:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd3994a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.093765:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd3994a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094514:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd3994a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094522:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2179a00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302243.094527:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd3994a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094536:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd3994a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094553:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962300) 00010000:00010000:3.0:1789302243.094556:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302243.094562:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd3994a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094568:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd3994a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094596:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094603:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094609:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094615:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2179200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302243.094618:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094624:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094633:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cc381fa8600) 00010000:00010000:3.0:1789302243.094635:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302243.094638:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094644:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094700:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd39949e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59e8 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094718:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3994b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59e8 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.094738:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc381fa8300) 00010000:00010000:3.0:1789302243.094741:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789302243.094743:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178200, rc 0) 00000100:00100000:3.0:1789302243.094852:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+7:10508:x1876219101469568:12345-192.168.203.9@tcp:101:touch.500 Request processed in 29900us (30173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302243.094862:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00100000:0.0:1789302243.102747:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302243.102911:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101469824 00000100:00100000:2.0:1789302243.102923:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101469824 00000100:00100000:2.0:1789302243.103033:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:2.0:1789302243.103045:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:10508:x1876219101469824:12345-192.168.203.9@tcp:101:touch.500 00010000:00010000:2.0:1789302243.103084:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302243.103142:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3994ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a59ef expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.103464:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3994c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.103513:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3994c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.103527:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3994c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.106521:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.106546:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.106560:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302243.108542:0:9541:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789302243.109471:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3994cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109491:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3994cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109515:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3994cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109556:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3994c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109563:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3994c1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109571:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3994c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109591:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302243.109595:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3994c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109602:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3994c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109615:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc381fa8300) 00010000:00010000:2.0:1789302243.109618:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302243.109623:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3994c1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109629:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3994c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302243.109644:0:9541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af936b77 reply state 000000003ffa79ac transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109655:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109673:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff8cc490721a00) 00010000:00010000:2.0:1789302243.109676:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789302243.109679:0:9541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789302243.109792:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3994ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59ef expref: 10 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109810:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3994cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59ef expref: 9 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.109828:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cc490721000) 00010000:00010000:2.0:1789302243.109830:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302243.109833:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348200, rc 0) 00000100:00100000:2.0:1789302243.109913:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+10:10508:x1876219101469824:12345-192.168.203.9@tcp:101:touch.500 Request processed in 6869us (7179us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789302243.109921:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:0.0:1789302243.113245:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302243.113586:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101470080 00000100:00100000:2.0:1789302243.113596:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101470080 00000100:00100000:2.0:1789302243.113712:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:2.0:1789302243.113798:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+10:10508:x1876219101470080:12345-192.168.203.9@tcp:36:touch.500 00010000:00010000:2.0:1789302243.113859:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302243.113883:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3994cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59ef expref: 10 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.113900:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cc490721000) 00010000:00010000:2.0:1789302243.113910:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302243.113956:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.113970:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.113979:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302243.114073:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b078b94a reply state 000000000e421370 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.114616:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.114627:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cc490721600) 00010000:00010000:2.0:1789302243.114630:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789302243.114633:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789302243.122008:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+11:10508:x1876219101470080:12345-192.168.203.9@tcp:36:touch.500 Request processed in 8204us (8761us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789302243.122021:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:0.0:1789302243.124534:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302243.124646:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101470208 00000100:00100000:3.0:1789302243.124661:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101470208 00000100:00100000:3.0:1789302243.124741:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 32 00000100:00100000:3.0:1789302243.124753:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+11:10508:x1876219101470208:12345-192.168.203.9@tcp:101:touch.500 00010000:00010000:3.0:1789302243.124854:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302243.124883:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a59f6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.124958:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59f6 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.124976:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59f6 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.124999:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cc490721600) 00010000:00010000:3.0:1789302243.125002:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302243.125007:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2179200, rc 0) 00000100:00100000:3.0:1789302243.125080:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+12:10508:x1876219101470208:12345-192.168.203.9@tcp:101:touch.500 Request processed in 329us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302243.125108:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 32 00000100:00100000:3.0:1789302243.128032:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302243.128257:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101470336 00000100:00100000:2.0:1789302243.128272:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101470336 00000100:00100000:2.0:1789302243.128331:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:2.0:1789302243.128340:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1876219101470336:12345-192.168.203.9@tcp:8:touch.500 00010000:00080000:2.0:1789302243.128375:0:8447:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:2.0:1789302243.128404:0:8447:0:(genops.c:1384:class_connect()) connect: client c76ee310-c3b4-4286-aaea-77936c269d98, cookie 0x1ff82925bd3994eb 00002000:00100000:2.0:1789302243.128415:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c76ee310-c3b4-4286-aaea-77936c269d98/ffff8cc38401d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789302243.128426:0:8447:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789302243.128537:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789302243.128574:0:8447:0:(import.c:65:import_set_state_nolock()) ffff8cc38401f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302243.128647:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2395:x1876219101470336:12345-192.168.203.9@tcp:8:touch.500 Request processed in 306us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302243.128656:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:0.0:1789302243.132044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302243.135925:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101470464 00000100:00100000:2.0:1789302243.135940:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101470464 00000100:00100000:2.0:1789302243.136035:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:2.0:1789302243.136046:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:0:x1876219101470464:12345-192.168.203.9@tcp:2:touch.500 00000100:00080000:1.0:1789302243.136321:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789302243.152037:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1789302243.152057:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000100:00100000:2.0:1789302243.152382:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:0:x1876219101470464:12345-192.168.203.9@tcp:2:touch.500 Request processed in 16329us (20344us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789302243.155484:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302243.155603:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101470720 00000100:00100000:3.0:1789302243.155613:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101470720 00000100:00100000:3.0:1789302243.155679:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2 00000100:00100000:3.0:1789302243.155688:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+12:10508:x1876219101470720:12345-192.168.203.9@tcp:35:touch.500 00000100:00100000:3.0:1789302243.155972:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+13:10508:x1876219101470720:12345-192.168.203.9@tcp:35:touch.500 Request processed in 284us (496us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789302243.155980:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2 00000100:00100000:2.0:1789302243.157277:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:3.0:1789302243.167295:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302243.169590:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101470848 00000100:00100000:2.0:1789302243.169612:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101470848 00000100:00100000:2.0:1789302243.169706:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 33 00000100:00100000:2.0:1789302243.169719:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+13:10509:x1876219101470848:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1789302243.169750:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302243.169778:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3994f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a59fd expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.169864:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3994f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.169883:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3994f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.169897:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3994f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302243.169949:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789302243.169953:0:9541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302243.169998:0:9541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3994f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.170031:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3994f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59fd expref: 15 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.170056:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3994f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59fd expref: 14 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.170089:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc381fa8300) 00010000:00010000:2.0:1789302243.170093:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302243.170098:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349200, rc 0) 00000100:00100000:2.0:1789302243.170210:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:10509:x1876219101470848:12345-192.168.203.9@tcp:101:rm.0 Request processed in 494us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302243.170218:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 33 00000100:00100000:1.0:1789302243.185642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302243.185780:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101471104 00000100:00100000:2.0:1789302243.185798:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101471104 00000100:00100000:2.0:1789302243.185894:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 34 00000100:00100000:2.0:1789302243.185907:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+14:10509:x1876219101471104:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:2.0:1789302243.185934:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302243.185967:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a04 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302243.186098:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789302243.186311:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399500 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a04 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.186328:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962300) 00010000:00010000:2.0:1789302243.186331:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302243.186338:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a04 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.186355:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348000, rc 0) 00000100:00100000:2.0:1789302243.186432:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+15:10509:x1876219101471104:12345-192.168.203.9@tcp:101:rm.0 Request processed in 528us (798us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789302243.186451:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 34 00000100:00100000:3.0:1789302243.208109:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302243.208197:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101471232 00000100:00100000:0.0:1789302243.208208:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101471232 00000100:00100000:0.0:1789302243.208265:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:0.0:1789302243.208275:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+15:10509:x1876219101471232:12345-192.168.203.9@tcp:37:rm.0 00000100:00100000:1.0:1789302243.212954:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+15:10509:x1876219101471232:12345-192.168.203.9@tcp:37:rm.0 Request processed in 4671us (4845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302243.212971:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:0.0:1789302243.219589:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302243.219845:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101471488 00000100:00100000:3.0:1789302243.219855:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101471488 00000100:00100000:3.0:1789302243.219917:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4 00000100:00100000:3.0:1789302243.219928:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+15:10509:x1876219101471488:12345-192.168.203.9@tcp:35:rm.0 00000100:00100000:3.0:1789302243.220169:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+16:10509:x1876219101471488:12345-192.168.203.9@tcp:35:rm.0 Request processed in 242us (589us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789302243.220177:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4 00000100:00100000:0.0:1789302243.227565:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302243.227803:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101471744 00000100:00100000:3.0:1789302243.227813:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101471744 00000100:00100000:3.0:1789302243.227874:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 35 00000100:00100000:3.0:1789302243.227884:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+16:10509:x1876219101471744:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:3.0:1789302243.227906:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302243.227940:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd39950e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a0b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.228043:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178400/0x1ff82925bd399515 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.228058:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178400/0x1ff82925bd399515 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.228069:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178400/0x1ff82925bd399515 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302243.228080:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789302243.228212:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179a00/0x1ff82925bd39950e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a0b expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.228441:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178400/0x1ff82925bd399515 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a0b expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.228455:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc381fa8300) 00010000:00010000:3.0:1789302243.228458:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789302243.228462:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178400, rc 0) 00000100:00100000:0.0:1789302243.228570:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+18:10509:x1876219101471744:12345-192.168.203.9@tcp:101:rm.0 Request processed in 685us (1013us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789302243.228578:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 35 00000100:00100000:1.0:1789302243.235964:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302243.236064:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101471872 00000100:00100000:2.0:1789302243.236075:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101471872 00000100:00100000:2.0:1789302243.236167:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 36 00000100:00100000:2.0:1789302243.236179:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+18:10509:x1876219101471872:12345-192.168.203.9@tcp:41:rm.0 00000004:00000024:2.0:1789302243.236242:0:9541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789302243.236306:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+18:10509:x1876219101471872:12345-192.168.203.9@tcp:41:rm.0 Request processed in 130us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302243.236313:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 36 00000100:00100000:3.0:1789302243.244588:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302243.244962:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101472000 00000100:00100000:1.0:1789302243.244972:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101472000 00000100:00100000:1.0:1789302243.245029:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 37 00000100:00100000:1.0:1789302243.245039:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+18:10509:x1876219101472000:12345-192.168.203.9@tcp:101:rm.0 00010000:00010000:1.0:1789302243.245074:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302243.245094:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2a00/0x1ff82925bd399523 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a12 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245199:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39952a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245215:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39952a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245436:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39952a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245449:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399531 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245458:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399531 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245465:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399531 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245589:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399538 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245598:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245605:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302243.245797:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789302243.245807:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302243.245825:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245837:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245845:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39952a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245852:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39952a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245860:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39952a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245865:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302243.245869:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39952a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245877:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39952a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245888:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc381fa8300) 00010000:00010000:1.0:1789302243.245891:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302243.245895:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39952a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245901:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39952a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.245914:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399531 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.246022:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399531 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.246029:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399531 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.246034:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302243.246037:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399531 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.246044:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399531 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.246052:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff8cc490721a00) 00010000:00010000:1.0:1789302243.246054:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302243.246057:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399531 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.246063:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3400/0x1ff82925bd399531 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.246088:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2a00/0x1ff82925bd399523 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a12 expref: 20 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.246100:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399538 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a12 expref: 19 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302243.246107:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cc490721600) 00010000:00010000:1.0:1789302243.246330:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302243.246340:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2200, rc 0) 00000100:00100000:1.0:1789302243.246473:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+19:10509:x1876219101472000:12345-192.168.203.9@tcp:101:rm.0 Request processed in 1434us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302243.246481:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 37 00000100:00100000:1.0:1789302243.253044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302243.253170:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101472256 00000100:00100000:0.0:1789302243.253179:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101472256 00000100:00100000:0.0:1789302243.253334:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 38 00000100:00100000:0.0:1789302243.253345:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+19:10509:x1876219101472256:12345-192.168.203.9@tcp:36:rm.0 00010000:00010000:0.0:1789302243.253395:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789302243.253419:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399538 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a12 expref: 19 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.253441:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3994e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59f6 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.253453:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cc490721600) 00010000:00010000:0.0:1789302243.253462:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3994f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59fd expref: 17 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.253471:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc381fa8300) 00010000:00010000:0.0:1789302243.253474:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302243.253504:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f000/0x1ff82925bd39953f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.253518:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f000/0x1ff82925bd39953f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.253527:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f000/0x1ff82925bd39953f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.253552:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.253571:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.253578:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.253672:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39954d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.253681:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39954d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.253688:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39954d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789302243.254001:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789302243.254011:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319296898261ns, next at 320296895589ns, rc = 0 00010000:00010000:0.0:1789302243.254056:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd399554 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254065:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd399554 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254073:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd399554 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254080:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd399554 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254097:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd399554 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254102:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd399554 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254166:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302243.254197:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39954d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254203:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39954d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254210:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39954d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254393:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538fc00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302243.254399:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39954d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254412:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39954d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254422:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cc490721600) 00010000:00010000:0.0:1789302243.254425:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789302243.254428:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39954d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254434:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39954d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254449:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f000/0x1ff82925bd39953f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254462:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f000/0x1ff82925bd39953f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254468:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f000/0x1ff82925bd39953f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254472:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302243.254475:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f000/0x1ff82925bd39953f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254481:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f000/0x1ff82925bd39953f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254487:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc381fa8300) 00010000:00010000:0.0:1789302243.254489:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302243.254492:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f000/0x1ff82925bd39953f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254506:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f000/0x1ff82925bd39953f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789302243.254516:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bc6733d reply state 00000000455639f3 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254526:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302243.254531:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff8cc490721a00) 00010000:00010000:0.0:1789302243.254533:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789302243.254536:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789302243.254677:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302243.254684:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd399554 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.254690:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538fe00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302243.254693:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd399554 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.254709:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd399554 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.254726:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cc490721600) 00010000:00010000:3.0:1789302243.254728:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789302243.254732:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd399554 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.254737:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd399554 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302243.254747:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302243.254749:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302243.254751:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302243.254830:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+18:10509:x1876219101472256:12345-192.168.203.9@tcp:36:rm.0 Request processed in 1484us (1791us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789302243.254845:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 38 00000100:00100000:0.0:1789302243.266047:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302243.266466:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101472512 00000100:00100000:2.0:1789302243.266480:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101472512 00000100:00100000:2.0:1789302243.266611:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5 00000100:00100000:2.0:1789302243.266623:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+18:10509:x1876219101472512:12345-192.168.203.9@tcp:35:rm.0 00000100:00100000:2.0:1789302243.267690:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+19:10509:x1876219101472512:12345-192.168.203.9@tcp:35:rm.0 Request processed in 1064us (1653us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789302243.267701:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5 00000100:00100000:1.0:1789302243.276980:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302243.281807:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101472768 00000100:00100000:0.0:1789302243.281822:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101472768 00000100:00100000:2.0:1789302243.281979:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 39 00000100:00100000:2.0:1789302243.281990:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+19:10509:x1876219101472768:12345-192.168.203.9@tcp:36:rm.0 00010000:00010000:2.0:1789302243.282046:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789302243.282072:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178400/0x1ff82925bd399515 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a0b expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.282094:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3994b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59e8 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.283358:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc381fa8300) 00010000:00010000:2.0:1789302243.283386:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2000/0x1ff82925bd399474 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59da expref: 17 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.283396:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962300) 00010000:00010000:2.0:1789302243.283507:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302243.283536:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39955b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.283549:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39955b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.283559:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39955b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.283571:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.283578:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.283583:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.283664:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399569 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.283673:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399569 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.283697:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399569 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302243.283976:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789302243.283989:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399569 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.283996:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399569 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284002:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399569 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284008:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302243.284012:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399569 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284018:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399569 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284027:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cc490721d00) 00010000:00010000:2.0:1789302243.284029:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789302243.284033:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399569 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284038:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399569 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284055:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39955b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284061:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39955b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284087:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39955b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284092:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302243.284095:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39955b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284101:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39955b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284109:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc490721000) 00010000:00010000:2.0:1789302243.284790:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302243.284796:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39955b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284804:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39955b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302243.284821:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df6897af reply state 0000000071568705 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284833:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302243.284839:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cc490721100) 00010000:00010000:2.0:1789302243.284842:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789302243.284845:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302243.284934:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+18:10509:x1876219101472768:12345-192.168.203.9@tcp:36:rm.0 Request processed in 2943us (7960us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789302243.284943:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 39 00010000:00010000:3.0:1789302243.732482:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302244.441923:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302244.441943:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121481856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302244.442007:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.442298:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121482112:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.442328:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.442346:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121482624:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.442365:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.442381:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121483136:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.442400:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.442421:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789302244.442426:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121482240:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.442447:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.442462:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121482752:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.442496:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.442516:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121483264:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.442535:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.442562:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121482112 00000100:00100000:2.0:1789302244.442569:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121482112 00000100:00100000:2.0:1789302244.442608:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121482624 00000100:00100000:2.0:1789302244.442611:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121482624 00000100:00100000:2.0:1789302244.442631:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121483136 00000100:00100000:2.0:1789302244.442633:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121483136 00000100:00100000:2.0:1789302244.442648:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789302244.442655:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121482112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.442699:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121482112:12345-0@lo:400:kworker.0 Request processed in 44us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.442721:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789302244.442738:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789302244.442743:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121482624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.442766:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121482624:12345-0@lo:400:kworker.0 Request processed in 23us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.442771:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789302244.442779:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789302244.442784:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121483136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.442803:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121483136:12345-0@lo:400:kworker.0 Request processed in 19us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.442808:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789302244.442826:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121481856 00000100:00100000:2.0:1789302244.442829:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121481856 00000100:00100000:2.0:1789302244.442844:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121482240 00000100:00100000:2.0:1789302244.442846:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121482240 00000100:00100000:2.0:1789302244.442856:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789302244.442861:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121481856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302244.442882:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789302244.442908:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121481856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.442913:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789302244.442923:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789302244.442928:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121482240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.442948:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121482240:12345-0@lo:400:kworker.0 Request processed in 21us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.442961:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789302244.442976:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121482752 00000100:00100000:2.0:1789302244.442979:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121482752 00000100:00100000:2.0:1789302244.442995:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121483264 00000100:00100000:2.0:1789302244.442997:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121483264 00000100:00100000:2.0:1789302244.443011:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789302244.443016:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121482752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443041:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121482752:12345-0@lo:400:kworker.0 Request processed in 25us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.443046:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789302244.443054:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789302244.443059:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121483264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443078:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121483264:12345-0@lo:400:kworker.0 Request processed in 19us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.443083:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789302244.443107:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121481984:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443152:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.443173:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121482496:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443191:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.443203:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121483008:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443218:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.443245:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121481856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302244.443272:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789302244.443277:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121482368:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443296:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.443316:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121482880:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443334:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.443346:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121483392:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443363:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302244.443385:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121481984 00000100:00100000:2.0:1789302244.443389:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121481984 00000100:00100000:2.0:1789302244.443411:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789302244.443416:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121481984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443443:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121481984:12345-0@lo:400:kworker.0 Request processed in 27us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.443449:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789302244.443470:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121482880 00000100:00100000:2.0:1789302244.443473:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121482880 00000100:00100000:2.0:1789302244.443497:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121483392 00000100:00100000:2.0:1789302244.443499:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121483392 00000100:00100000:2.0:1789302244.443514:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789302244.443519:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121482880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443543:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121482880:12345-0@lo:400:kworker.0 Request processed in 24us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.443548:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789302244.443556:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789302244.443561:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121483392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443580:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121483392:12345-0@lo:400:kworker.0 Request processed in 19us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.443585:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789302244.443596:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121482496 00000100:00100000:2.0:1789302244.443598:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121482496 00000100:00100000:2.0:1789302244.443621:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121483008 00000100:00100000:2.0:1789302244.443623:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121483008 00000100:00100000:2.0:1789302244.443632:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121482368 00000100:00100000:2.0:1789302244.443634:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121482368 00000100:00100000:2.0:1789302244.443643:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789302244.443648:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121482496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443673:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121482496:12345-0@lo:400:kworker.0 Request processed in 25us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.443679:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789302244.443687:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789302244.443692:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121483008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443710:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121483008:12345-0@lo:400:kworker.0 Request processed in 18us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.443715:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789302244.443723:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789302244.443727:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121482368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443761:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121482368:12345-0@lo:400:kworker.0 Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302244.443766:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789302244.443794:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121482240:0@lo:400:kworker.0 00010000:00080000:2.0:1789302244.443805:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc382917480 x1876219121482752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302244.443815:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121482752:0@lo:400:kworker.0 00010000:00080000:2.0:1789302244.443824:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efa300 x1876219121483264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302244.443842:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121483264:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443853:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121482112:0@lo:400:kworker.0 00010000:00080000:2.0:1789302244.443862:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383443b80 x1876219121482624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302244.443869:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121482624:0@lo:400:kworker.0 00010000:00080000:2.0:1789302244.443877:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efbb80 x1876219121483136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302244.443885:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121483136:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443915:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121482368:0@lo:400:kworker.0 00010000:00080000:2.0:1789302244.443923:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc382914700 x1876219121482880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302244.443930:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121482880:0@lo:400:kworker.0 00010000:00080000:2.0:1789302244.443937:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef8000 x1876219121483392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302244.443944:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121483392:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443951:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121481984:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443958:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121482496:0@lo:400:kworker.0 00000100:00100000:2.0:1789302244.443965:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121483008:0@lo:400:kworker.0 00000100:00080000:1.0:1789302244.444437:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302244.444443:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302244.444445:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302244.444447:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789302244.756866:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302244.948314:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121483520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302244.948386:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302244.948688:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121483520 00000100:00100000:3.0:1789302244.948697:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121483520 00000100:00100000:3.0:1789302244.948750:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789302244.948760:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121483520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789302244.948789:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302244.948837:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121483520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302244.948844:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789302244.948865:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302244.948874:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121483648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302244.948899:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302244.948929:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121483648 00000100:00100000:3.0:1789302244.948933:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121483648 00000100:00100000:3.0:1789302244.948955:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789302244.948971:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121483648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302244.948983:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302244.949168:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121483648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 198us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302244.949175:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1789302244.949222:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d52d80 x1876219121483520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302244.949239:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121483520:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789302244.949337:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd803800 x1876219121483648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302244.949349:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121483648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302245.463383:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302245.463419:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121483776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302245.463497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302245.463656:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121483776 00000100:00100000:0.0:1789302245.463664:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121483776 00000100:00100000:0.0:1789302245.463722:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789302245.463731:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121483776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302245.463763:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789302245.463812:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121483776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302245.463819:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789302245.464001:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121483776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789302245.719602:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302245.719638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302245.719659:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302245.719683:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302245.719701:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302245.719723:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302245.719746:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101473024 00000100:00100000:0.0:1789302245.719756:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101473024 00000100:00100000:0.0:1789302245.719808:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101473536 00000100:00100000:0.0:1789302245.719819:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101473536 00000100:00100000:0.0:1789302245.719835:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101473152 00000100:00100000:0.0:1789302245.719838:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101473152 00000100:00100000:0.0:1789302245.719849:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101473408 00000100:00100000:0.0:1789302245.719851:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101473408 00000100:00100000:0.0:1789302245.719866:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 231 00000100:00100000:0.0:1789302245.719875:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+18:2399:x1876219101473024:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302245.719953:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+18:2399:x1876219101473024:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 78us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302245.719960:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 231 00000100:00100000:0.0:1789302245.719977:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 232 00000100:00100000:0.0:1789302245.719984:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101473536:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302245.720007:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101473536:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302245.720012:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 232 00000100:00100000:0.0:1789302245.720022:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 233 00000100:00100000:0.0:1789302245.720027:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101473152:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302245.720048:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101473152:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302245.720053:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 233 00000100:00100000:0.0:1789302245.720064:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 234 00000100:00100000:0.0:1789302245.720070:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101473408:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302245.720201:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101473408:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 130us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302245.720207:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 234 00000100:00100000:0.0:1789302245.720230:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101473280 00000100:00100000:0.0:1789302245.720234:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101473280 00000100:00100000:0.0:1789302245.720274:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 106 00000100:00100000:0.0:1789302245.720281:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101473280:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302245.720308:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101473280:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302245.720313:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 106 00000100:00100000:0.0:1789302245.720463:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101472896 00000100:00100000:0.0:1789302245.720468:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101472896 00000100:00100000:0.0:1789302245.720506:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 342 00000100:00100000:0.0:1789302245.720513:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101472896:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302245.720540:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101472896:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302245.720546:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 342 00000100:00080000:0.0:1789302245.720583:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302245.720588:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302245.720590:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789302245.785790:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302246.806552:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789302247.441281:0:13695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1789302247.828419:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302248.020824:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121483904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302248.020896:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302248.022017:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121483904 00000100:00100000:1.0:1789302248.022028:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121483904 00000100:00100000:1.0:1789302248.022090:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789302248.022100:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121483904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789302248.022147:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302248.022215:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121483904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302248.022222:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:3.0:1789302248.022488:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f76680 x1876219121483904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302248.022508:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121483904:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789302248.023491:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302248.025585:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121484032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302248.025662:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789302248.025821:0:8848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324068707689ns, next at 325068705076ns, rc = 0 00000100:00100000:1.0:1789302248.026251:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121484032 00000100:00100000:1.0:1789302248.026261:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121484032 00000100:00100000:1.0:1789302248.026337:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789302248.026348:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121484032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302248.026380:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789302248.026455:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302248.030041:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121484032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3685us (4368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302248.030071:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1789302248.032843:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd802a00 x1876219121484032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302248.032870:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121484032:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1789302248.516054:0:13743:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4b2c1e10 20000000:00000080:3.0:1789302248.516072:0:13743:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cc4aeeffc00 uarg=0000000000000000 20000000:01000000:3.0:1789302248.518974:0:13743:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789302248.518982:0:13743:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789302248.519000:0:13743:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789302248.519809:0:13744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789302248.519966:0:13743:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789302248.531454:0:13743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789302248.531507:0:13743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789302248.531526:0:13743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789302248.531559:0:13743:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789302248.531580:0:13743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.531598:0:13743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd399404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3993fd expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.531606:0:13743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd399412 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39940b expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.531613:0:13743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b538f400/0x1ff82925bd399420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399419 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.531621:0:13743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39942e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399427 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.531630:0:13743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4c2178c00/0x1ff82925bd399435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59c5 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.531638:0:13743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b5348e00/0x1ff82925bd39943c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59cc expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.531645:0:13743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.531751:0:13743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b5348e00/0x1ff82925bd39943c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59cc expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.531884:0:13743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc4b5348e00/0x1ff82925bd39943c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59cc expref: 12 pid: 6524 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302248.531899:0:13743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484160:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302248.532655:0:13743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4c2178c00/0x1ff82925bd399435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59c5 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.532667:0:13743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc4c2178c00/0x1ff82925bd399435 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59c5 expref: 12 pid: 6523 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302248.532678:0:13743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484288:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302248.532880:0:13743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39942e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399427 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.532890:0:13743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39942e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399427 expref: 23 pid: 6524 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302248.532899:0:13743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484416:0@lo:104: 00000100:00100000:1.0:1789302248.532935:0:13743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302248.532969:0:13743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b538f400/0x1ff82925bd399420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd399419 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.532984:0:13743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4b538f400/0x1ff82925bd399420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd399419 expref: 23 pid: 6524 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302248.532993:0:13743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484544:0@lo:104: 00000100:00100000:0.0:1789302248.533012:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789302248.533028:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121484416 00000100:00100000:0.0:1789302248.533035:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121484416 00000100:00100000:0.0:1789302248.533081:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789302248.533090:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383451850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:13743:x1876219121484416:12345-0@lo:104: 00010000:00010000:0.0:1789302248.533102:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302248.542759:0:13743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302248.548032:0:13743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd399412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39940b expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.548049:0:13743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd399412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39940b expref: 23 pid: 6523 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302248.548065:0:13743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484672:0@lo:104: 00000100:00100000:1.0:1789302248.548169:0:13743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302248.548217:0:13743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd399404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd3993fd expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.548227:0:13743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd399404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd3993fd expref: 23 pid: 6525 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302248.548235:0:13743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7effb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484800:0@lo:104: 00000100:00100000:1.0:1789302248.548261:0:13743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302248.548272:0:13743:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383a38a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789302248.548869:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302248.548878:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383451850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:13743:x1876219121484416:12345-0@lo:104: Request processed in 15789us (15942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302248.548889:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789302248.548938:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121484544 00000100:00100000:0.0:1789302248.548946:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121484544 00000100:00100000:0.0:1789302248.548971:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121484672 00000100:00100000:0.0:1789302248.548974:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121484672 00000100:00100000:0.0:1789302248.548983:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121484800 00000100:00100000:0.0:1789302248.548985:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121484800 00000100:00100000:0.0:1789302248.548997:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789302248.549004:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+5:13743:x1876219121484544:12345-0@lo:104: 00010000:00010000:0.0:1789302248.549016:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549061:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789302248.549067:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+5:13743:x1876219121484544:12345-0@lo:104: Request processed in 63us (6317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302248.549072:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789302248.549084:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789302248.549090:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+4:13743:x1876219121484672:12345-0@lo:104: 00010000:00010000:0.0:1789302248.549097:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549158:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789302248.549163:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+4:13743:x1876219121484672:12345-0@lo:104: Request processed in 74us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302248.549181:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789302248.549195:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789302248.549200:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:13743:x1876219121484800:12345-0@lo:104: 00010000:00010000:0.0:1789302248.549207:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549233:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789302248.549237:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:483e1a3c-0199-48dd-94ee-f480825c6196+3:13743:x1876219121484800:12345-0@lo:104: Request processed in 38us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302248.549241:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1789302248.549284:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789302248.549290:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549297:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:0.0:1789302248.549301:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549309:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302248.549316:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302248.549322:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789302248.549349:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549355:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302248.549378:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549385:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349000/0x1ff82925bd399427 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39942e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549397:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789302248.549401:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549406:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349e00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:0.0:1789302248.549408:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549415:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302248.549420:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302248.549425:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789302248.549917:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549924:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302248.549932:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549938:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd399419 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399420 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549948:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789302248.549957:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549963:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3600 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:0.0:1789302248.549966:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.549973:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302248.549980:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302248.549985:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789302248.549997:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.550003:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302248.550020:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.550027:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3600/0x1ff82925bd39940b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399412 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.550035:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302248.550038:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.550044:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3a00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:0.0:1789302248.550046:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.550063:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302248.550069:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302248.550074:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789302248.550087:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.550092:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302248.550098:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.550105:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3a00/0x1ff82925bd3993fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd399404 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.550264:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302248.550281:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121485056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302248.550324:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302248.550360:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302248.550366:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121484928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302248.550385:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302248.550408:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121485312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302248.550438:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302248.550604:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302248.550612:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121485184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302248.550633:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302248.550664:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121485056 00000100:00100000:3.0:1789302248.550670:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121485056 00010000:00010000:0.0:1789302248.550932:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302248.550935:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302248.550936:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302248.551145:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b538f400/0x1ff82925bd399420 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399419 expref: 24 pid: 6524 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302248.551173:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121484928 00000100:00100000:3.0:1789302248.551176:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121484928 00010000:00010000:3.0:1789302248.551189:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39942e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399427 expref: 25 pid: 6524 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302248.551199:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121485312 00000100:00100000:3.0:1789302248.551201:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121485312 00010000:00010000:3.0:1789302248.551209:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd399404 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3993fd expref: 26 pid: 6525 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302248.551218:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121485184 00000100:00100000:3.0:1789302248.551220:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121485184 00010000:00010000:3.0:1789302248.551229:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd399412 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39940b expref: 27 pid: 6523 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302248.551252:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789302248.551259:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:483e1a3c-0199-48dd-94ee-f480825c6196+27:3648:x1876219121485056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302248.551271:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302248.551275:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b538f400/0x1ff82925bd399420 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399419 expref: 27 pid: 6524 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.551283:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b538f400/0x1ff82925bd399420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399419 expref: 27 pid: 6524 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.551297:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302248.551333:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:483e1a3c-0199-48dd-94ee-f480825c6196+27:3648:x1876219121485056:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302248.551339:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789302248.551353:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789302248.551358:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:483e1a3c-0199-48dd-94ee-f480825c6196+26:3648:x1876219121484928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302248.551365:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302248.551369:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39942e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd399427 expref: 26 pid: 6524 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.551375:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39942e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd399427 expref: 26 pid: 6524 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.551383:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302248.551400:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:483e1a3c-0199-48dd-94ee-f480825c6196+26:3648:x1876219121484928:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302248.551404:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789302248.551415:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789302248.551501:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:483e1a3c-0199-48dd-94ee-f480825c6196+25:3646:x1876219121485312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302248.551510:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302248.551514:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd399404 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd3993fd expref: 25 pid: 6525 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.551586:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd399404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd3993fd expref: 25 pid: 6525 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.551597:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302248.551628:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:483e1a3c-0199-48dd-94ee-f480825c6196+25:3646:x1876219121485312:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302248.551634:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789302248.551647:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789302248.551652:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121485184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302248.551659:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302248.551663:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd399412 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39940b expref: 24 pid: 6523 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.551669:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd399412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39940b expref: 24 pid: 6523 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.551968:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302248.551994:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121485184:12345-0@lo:103:ldlm_bl.0 Request processed in 343us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302248.552001:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789302248.552151:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121484928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302248.552163:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121485056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302248.552189:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121485184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302248.552207:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121485312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302248.554382:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302248.554590:0:13743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2178800/0x1ff82925bd39942e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399427 expref: 23 pid: 6524 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302248.554608:0:13743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484416:0@lo:104: 00010000:00010000:1.0:1789302248.554620:0:13743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538f400/0x1ff82925bd399420 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd399419 expref: 22 pid: 6524 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302248.554628:0:13743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484544:0@lo:104: 00010000:00010000:1.0:1789302248.554636:0:13743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5348600/0x1ff82925bd399412 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39940b expref: 21 pid: 6523 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302248.554643:0:13743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484672:0@lo:104: 00010000:00010000:1.0:1789302248.554651:0:13743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd399404 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd3993fd expref: 20 pid: 6525 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302248.555558:0:13743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7effb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484800:0@lo:104: 00000004:00080000:0.0:1789302248.556505:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789302248.556700:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1789302248.556710:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789302248.556745:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556757:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556765:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556770:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302248.556775:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556783:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556802:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff8cc490721a00) 00010000:00010000:1.0:1789302248.556806:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302248.556810:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556816:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3994c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556834:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556840:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556862:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556866:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302248.556869:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556875:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556882:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cc490721600) 00010000:00010000:1.0:1789302248.556884:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302248.556887:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556892:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3994dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556909:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556914:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556919:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556923:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302248.556925:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556939:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556947:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff8cc490721a00) 00010000:00010000:1.0:1789302248.556949:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302248.556952:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556957:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd399546 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556971:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556977:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556985:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556989:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302248.556992:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.556997:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.557004:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cc490721100) 00010000:00010000:1.0:1789302248.557006:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302248.557009:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302248.557021:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399562 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302248.567931:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302248.568240:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302248.568267:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101473664 00000100:00100000:3.0:1789302248.568275:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101473664 00010000:00010000:3.0:1789302248.568309:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b5348e00/0x1ff82925bd39943c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59cc expref: 13 pid: 6524 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302248.568334:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101473792 00000100:00100000:3.0:1789302248.568337:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101473792 00010000:00010000:3.0:1789302248.568347:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4c2178c00/0x1ff82925bd399435 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59c5 expref: 14 pid: 6523 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302248.568364:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 50 00000100:00100000:3.0:1789302248.568372:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60e561d9-781c-4e5b-be29-fcae8ab02e31+14:2398:x1876219101473664:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302248.568384:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302248.568389:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b5348e00/0x1ff82925bd39943c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59cc expref: 14 pid: 6524 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.568402:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b5348e00/0x1ff82925bd39943c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59cc expref: 14 pid: 6524 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.568421:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302248.568955:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302248.568974:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121485440:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789302248.569027:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302248.569338:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60e561d9-781c-4e5b-be29-fcae8ab02e31+14:2398:x1876219101473664:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 964us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302248.569348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 50 00000100:00100000:3.0:1789302248.569386:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 51 00000100:00100000:3.0:1789302248.569395:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101473792:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302248.569863:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302248.569872:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4c2178c00/0x1ff82925bd399435 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59c5 expref: 13 pid: 6523 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.569887:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4c2178c00/0x1ff82925bd399435 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59c5 expref: 13 pid: 6523 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.569904:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.569913:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.569928:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.569935:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.569942:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.569949:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.569955:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3400 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302248.569959:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.569967:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.569985:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.569995:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302248.570029:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101473792:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 636us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302248.570036:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 51 00000100:00100000:3.0:1789302248.570062:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121485440 00000100:00100000:3.0:1789302248.570067:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121485440 00000100:00100000:3.0:1789302248.570104:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789302248.570129:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121485440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789302248.570601:0:8446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1789302248.570635:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa695e3, atime: 0x6aa695e3, ctime: 0x6aa695e3, blocks: 0x0 00010000:00010000:3.0:1789302248.570641:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b79707/0x1ff82925bd399577 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.570656:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1789302248.570660:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302248.570665:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000b79707/0x1ff82925bd399577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.571614:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000b79707/0x1ff82925bd399577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.571629:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b79707/0x1ff82925bd399577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.571652:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000b79707/0x1ff82925bd399577 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302248.571668:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302248.572233:0:13743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5348e00/0x1ff82925bd39943c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59cc expref: 12 pid: 6524 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302248.572236:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302248.572244:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000b79707/0x1ff82925bd399577 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302248.572254:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178600 already unused, calling callback (ffffffffc0dce8b0) 00000100:00100000:0.0:1789302248.572257:0:13743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484160:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302248.572260:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b79707/0x1ff82925bd399577 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302248.572273:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b79707/0x1ff82925bd399577 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.572275:0:13743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2178c00/0x1ff82925bd399435 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a59c5 expref: 11 pid: 6523 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302248.572295:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000b79707/0x1ff82925bd399577 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302248.572299:0:13743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13743:1876219121484288:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302248.572310:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000b79707/0x1ff82925bd399577 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302248.572336:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302248.572338:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302248.572341:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302248.572351:0:13743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.572361:0:13743:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.572367:0:13743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302248.572382:0:13743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd399570 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302248.572646:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121485440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2534us (3617us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789302248.572655:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1789302248.573584:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc4b7eee680/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789302248.573593:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121485440:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789302248.852651:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302249.556595:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121485568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302249.556698:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302249.556790:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121485568 00000100:00100000:2.0:1789302249.556801:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121485568 00000100:00100000:2.0:1789302249.556856:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789302249.556867:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121485568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302249.556908:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789302249.556963:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121485568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302249.556971:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789302249.557022:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121485568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302249.557304:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121485952:0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.557343:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302249.557366:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121486464:0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.557394:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302249.557419:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121486976:0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.557444:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302249.557471:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789302249.557478:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121486080:0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.557504:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302249.557522:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121486592:0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.557544:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302249.557562:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121487104:0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.557599:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302249.557626:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121485952 00000100:00100000:0.0:1789302249.557631:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121485952 00000100:00100000:0.0:1789302249.557660:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789302249.557668:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121485952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.557709:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121485952:12345-0@lo:400:kworker.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302249.557717:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789302249.557738:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121486464 00000100:00100000:0.0:1789302249.557742:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121486464 00000100:00100000:0.0:1789302249.557761:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121486976 00000100:00100000:0.0:1789302249.557763:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121486976 00000100:00100000:0.0:1789302249.557785:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121486592 00000100:00100000:0.0:1789302249.557788:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121486592 00000100:00100000:0.0:1789302249.557800:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121487104 00000100:00100000:0.0:1789302249.557802:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121487104 00000100:00100000:0.0:1789302249.557815:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789302249.557821:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121486464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.557854:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121486464:12345-0@lo:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302249.557860:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789302249.557872:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789302249.557877:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121486976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.557903:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121486976:12345-0@lo:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302249.557909:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789302249.557919:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789302249.557925:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121486592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.557961:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121486592:12345-0@lo:400:kworker.0 Request processed in 36us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302249.557968:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789302249.557978:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789302249.557983:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121487104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.558006:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121487104:12345-0@lo:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302249.558012:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789302249.558030:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121486080 00000100:00100000:0.0:1789302249.558035:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121486080 00000100:00100000:0.0:1789302249.558061:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789302249.558067:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121486080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.558094:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121486080:12345-0@lo:400:kworker.0 Request processed in 27us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302249.558099:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:0.0:1789302249.558146:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302249.558185:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121486080:0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.558196:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121486592:0@lo:400:kworker.0 00010000:00080000:0.0:1789302249.558208:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d50a80 x1876219121487104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302249.558219:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121487104:0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.558229:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121485952:0@lo:400:kworker.0 00000100:00100000:0.0:1789302249.558240:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121486464:0@lo:400:kworker.0 00010000:00080000:0.0:1789302249.558250:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d53100 x1876219121486976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302249.558267:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121486976:0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.558525:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121485824:0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.558565:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302249.558590:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121486336:0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.558610:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302249.558628:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121486848:0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.558645:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302249.558662:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789302249.558667:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121485696:0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.558690:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302249.558714:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121486208:0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.558733:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302249.558746:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121486720:0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.558785:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302249.558834:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121485824 00000100:00100000:3.0:1789302249.558839:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121485824 00000100:00100000:3.0:1789302249.558862:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121486336 00000100:00100000:3.0:1789302249.558870:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121486336 00000100:00100000:3.0:1789302249.558891:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121486848 00000100:00100000:3.0:1789302249.558893:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121486848 00000100:00100000:3.0:1789302249.558904:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121486208 00000100:00100000:3.0:1789302249.558907:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121486208 00000100:00100000:3.0:1789302249.558917:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121486720 00000100:00100000:3.0:1789302249.558918:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121486720 00000100:00100000:3.0:1789302249.558929:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789302249.558935:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121485824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.558970:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121485824:12345-0@lo:400:kworker.0 Request processed in 35us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302249.558976:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789302249.558989:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789302249.558995:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121486336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.559016:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121486336:12345-0@lo:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302249.559021:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789302249.559029:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789302249.559033:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121486848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.559052:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121486848:12345-0@lo:400:kworker.0 Request processed in 19us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302249.559056:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789302249.559064:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789302249.559070:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121486208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.559090:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121486208:12345-0@lo:400:kworker.0 Request processed in 21us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302249.559095:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789302249.559138:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789302249.559144:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121486720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.559170:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121486720:12345-0@lo:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302249.559175:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789302249.559203:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121485696 00000100:00100000:3.0:1789302249.559207:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121485696 00000100:00100000:3.0:1789302249.559231:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789302249.559237:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:3646:x1876219121485696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.559266:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:3646:x1876219121485696:12345-0@lo:400:kworker.0 Request processed in 29us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302249.559271:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:3.0:1789302249.559301:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302249.559305:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302249.559432:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121485696:0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.559446:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121486208:0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.559467:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121486720:0@lo:400:kworker.0 00000100:00100000:3.0:1789302249.559477:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121485824:0@lo:400:kworker.0 00010000:00080000:3.0:1789302249.559487:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f75180 x1876219121486336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302249.559497:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121486336:0@lo:400:kworker.0 00010000:00080000:3.0:1789302249.559506:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383a17100 x1876219121486848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302249.559515:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121486848:0@lo:400:kworker.0 00000020:00000080:2.0:1789302249.602955:0:13792:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1c2c1150 20000000:00000080:2.0:1789302249.602972:0:13792:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cc383b30000 uarg=0000000000000000 20000000:01000000:2.0:1789302249.603014:0:13792:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1789302249.603020:0:13792:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1789302249.603025:0:13792:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1789302249.606894:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789302249.610826:0:13792:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789302249.611030:0:13792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789302249.611062:0:13792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789302249.611078:0:13792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789302249.611091:0:13792:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789302249.611436:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39957e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302249.611561:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39957e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302249.611582:0:13792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39957e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302249.611590:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39957e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302249.611597:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39957e lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302249.611605:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39957e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302249.611611:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2179a00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302249.611615:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39957e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302249.611623:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39957e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302249.611636:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39957e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302249.611662:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39957e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302249.611669:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39957e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302249.878055:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302249.940782:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302249.944875:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101473920 00000100:00100000:0.0:1789302249.944897:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101473920 00000100:00100000:0.0:1789302249.944988:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 344 00000100:00100000:0.0:1789302249.945001:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:6168:x1876219101473920:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302249.945023:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302249.945294:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538f000/0x1ff82925bd399585 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a19 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302249.945423:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538f000/0x1ff82925bd399585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a19 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302249.945442:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538f000/0x1ff82925bd399585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a19 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302249.945465:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538f000, rc 0) 00000100:00100000:2.0:1789302249.945557:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101473920:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 Request processed in 557us (4851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302249.945564:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 344 00000100:00100000:2.0:1789302249.949578:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302249.949712:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101474048 00000100:00100000:0.0:1789302249.949734:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101474048 00000100:00100000:0.0:1789302249.950382:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 345 00000100:00100000:0.0:1789302249.950397:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101474048:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302249.950623:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101474048:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 Request processed in 229us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302249.950632:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 345 00000100:00100000:0.0:1789302249.952763:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302249.955472:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101474176 00000100:00100000:2.0:1789302249.955494:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101474176 00000100:00100000:2.0:1789302249.956167:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 346 00000100:00100000:2.0:1789302249.956186:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101474176:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302249.956407:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101474176:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 Request processed in 227us (3657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302249.956417:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 346 00000100:00100000:1.0:1789302249.962308:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302249.962852:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101474304 00000100:00100000:0.0:1789302249.962867:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101474304 00000100:00100000:0.0:1789302249.962954:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 347 00000100:00100000:0.0:1789302249.962969:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:10793:x1876219101474304:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302249.963238:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:10793:x1876219101474304:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 272us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302249.963248:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 347 00000100:00100000:0.0:1789302249.973985:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302249.974227:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101474432 00000100:00100000:2.0:1789302249.974241:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101474432 00000100:00100000:2.0:1789302249.974319:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 348 00000100:00100000:2.0:1789302249.974332:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:10793:x1876219101474432:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789302249.974544:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:10793:x1876219101474432:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 215us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302249.974553:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 348 00000100:00100000:1.0:1789302249.991108:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302249.991798:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101474560 00000100:00100000:0.0:1789302249.991812:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101474560 00000100:00100000:0.0:1789302249.991889:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 349 00000100:00100000:0.0:1789302249.991902:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:6168:x1876219101474560:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302249.991926:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302249.991953:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538fa00/0x1ff82925bd39958c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a20 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302249.991994:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538fa00/0x1ff82925bd39958c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a20 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302249.992008:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538fa00/0x1ff82925bd39958c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a20 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302249.992019:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538fa00, rc 0) 00000100:00100000:0.0:1789302249.992104:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:6168:x1876219101474560:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 Request processed in 204us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302249.993511:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 349 00000100:00100000:1.0:1789302249.994661:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302249.994763:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101474688 00000100:00100000:3.0:1789302249.994775:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101474688 00000100:00100000:3.0:1789302249.994841:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 350 00000100:00100000:3.0:1789302249.994853:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:6168:x1876219101474688:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302249.995057:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:6168:x1876219101474688:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 Request processed in 206us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302249.995066:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 350 00000100:00100000:1.0:1789302250.009101:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302250.010470:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101474816 00000100:00100000:3.0:1789302250.010489:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101474816 00000100:00100000:3.0:1789302250.010568:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 351 00000100:00100000:3.0:1789302250.010581:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:6168:x1876219101474816:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302250.010795:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:6168:x1876219101474816:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 Request processed in 216us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302250.010805:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 351 00000100:00100000:3.0:1789302250.029718:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302250.030368:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101474944 00000100:00100000:1.0:1789302250.030383:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101474944 00000100:00100000:1.0:1789302250.030475:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 352 00000100:00100000:1.0:1789302250.030489:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:10797:x1876219101474944:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789302250.030725:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:10797:x1876219101474944:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 238us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.030735:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 352 00000100:00100000:1.0:1789302250.035893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302250.040571:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101475072 00000100:00100000:0.0:1789302250.040595:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101475072 00000100:00100000:0.0:1789302250.040750:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 353 00000100:00100000:0.0:1789302250.040762:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:10797:x1876219101475072:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302250.040977:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:10797:x1876219101475072:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 216us (5097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302250.040986:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 353 00000100:00100000:2.0:1789302250.069389:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121487232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302250.069504:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302250.069746:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121487232 00000100:00100000:3.0:1789302250.069758:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121487232 00000100:00100000:3.0:1789302250.069821:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789302250.069852:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121487232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789302250.069895:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302250.069965:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121487232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302250.069972:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:2.0:1789302250.070291:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f0b800 x1876219121487232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302250.070313:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121487232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302250.070629:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302250.070641:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121487360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302250.070681:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302250.070766:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121487360 00000100:00100000:1.0:1789302250.070773:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121487360 00000100:00100000:1.0:1789302250.070819:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789302250.070828:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121487360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302250.070844:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302250.071509:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121487360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 678us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.071520:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:2.0:1789302250.074472:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eff800 x1876219121487360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302250.074540:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121487360:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1789302250.264040:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789302250.264071:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc382b0f800 from 7 10000000:01000000:0.0:1789302250.264076:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302250.264396:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.264412:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.264425:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302250.264469:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121487488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302250.264560:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302250.264661:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383b08b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302250.264774:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121487488 00000100:00100000:3.0:1789302250.264785:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121487488 00000100:00100000:3.0:1789302250.264848:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789302250.264858:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+20:6527:x1876219121487488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302250.264875:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302250.264891:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39959a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd399593 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302250.264919:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39959a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd399593 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302250.264945:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39959a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd399593 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302250.264956:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2179a00, rc 0) 00000100:00100000:3.0:1789302250.265008:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121487488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302250.265015:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789302250.265386:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121487488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302250.265403:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.265413:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302250.265496:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121487616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302250.265526:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302250.265555:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383b08b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302250.268751:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121487616 00000100:00100000:2.0:1789302250.268775:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121487616 00000100:00100000:2.0:1789302250.268871:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789302250.268884:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121487616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302250.269161:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121487616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (3632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302250.269169:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789302250.269357:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121487616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.269427:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121487744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.269515:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302250.269559:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a04f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302250.269722:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121487744 00000100:00100000:2.0:1789302250.269728:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121487744 00000100:00100000:2.0:1789302250.269767:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789302250.269775:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121487744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302250.270016:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121487744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302250.270023:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789302250.270147:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121487744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302250.271472:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13805:1876219121487872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302250.271561:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302250.271611:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302250.273168:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121487872 00000100:00100000:2.0:1789302250.273187:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121487872 00000100:00100000:2.0:1789302250.273286:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789302250.273299:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:13805:x1876219121487872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302250.273528:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+21:13805:x1876219121487872:12345-0@lo:502:llog_process_th.0 Request processed in 231us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302250.273538:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789302250.273747:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13805:1876219121487872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302250.273802:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302250.273813:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302250.273816:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789302250.273823:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc382b0f800 00000020:00000080:3.0:1789302250.273827:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789302250.273915:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302250.273920:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302250.273921:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789302250.273924:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302250.273926:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302250.273927:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789302250.273931:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc382b0f800 00000020:00000080:3.0:1789302250.273933:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789302250.273985:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13805:1876219121488000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302250.274039:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302250.274085:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc488c5cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302250.274318:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121488000 00000100:00100000:1.0:1789302250.274325:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121488000 00000100:00100000:1.0:1789302250.274372:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789302250.274381:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:13805:x1876219121488000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302250.274489:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+21:13805:x1876219121488000:12345-0@lo:502:llog_process_th.0 Request processed in 108us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.274496:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789302250.278473:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13805:1876219121488000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302250.278548:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302250.278559:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302250.278562:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789302250.278568:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789302250.278822:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789302250.278870:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302250.278884:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302250.278896:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302250.278910:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302250.278914:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4adc31000 from 7 10000000:01000000:1.0:1789302250.278917:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302250.278961:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302250.278970:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302250.278982:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302250.279022:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121488128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.279103:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302250.279183:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a04f9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302250.279324:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121488128 00000100:00100000:0.0:1789302250.279331:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121488128 00000100:00100000:0.0:1789302250.279389:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789302250.279399:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+21:6527:x1876219121488128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302250.279415:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302250.279439:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd3995a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3995a1 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.279478:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd3995a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3995a1 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.279490:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd3995a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3995a1 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.279499:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538ee00, rc 0) 00000100:00100000:0.0:1789302250.279541:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121488128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302250.279548:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789302250.280528:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121488128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302250.280555:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302250.280568:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302250.280674:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121488256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.280735:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302250.280778:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a04f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302250.280971:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121488256 00000100:00100000:3.0:1789302250.280979:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121488256 00000100:00100000:3.0:1789302250.281028:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789302250.281038:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121488256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302250.281217:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121488256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302250.281225:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789302250.281423:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121488256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.281466:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121488384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.281514:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302250.281544:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a04f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302250.281595:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121488384 00000100:00100000:3.0:1789302250.281600:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121488384 00000100:00100000:3.0:1789302250.281632:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789302250.281639:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121488384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302250.281746:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121488384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302250.281753:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789302250.283053:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121488384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.288019:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13806:1876219121488512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302250.288175:0:13806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302250.288236:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a04f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789302250.288480:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121488512 00000100:00100000:0.0:1789302250.288490:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121488512 00000100:00100000:0.0:1789302250.288555:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789302250.288565:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:13806:x1876219121488512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302250.288724:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+22:13806:x1876219121488512:12345-0@lo:502:llog_process_th.0 Request processed in 159us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302250.288733:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789302250.290166:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13806:1876219121488512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302250.290249:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302250.290279:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302250.290282:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789302250.290290:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc4adc31000 00000020:00000080:1.0:1789302250.290293:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789302250.290363:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302250.290366:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302250.290368:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789302250.290371:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302250.290373:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302250.290375:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789302250.290378:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc4adc31000 00000020:00000080:1.0:1789302250.290381:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789302250.290439:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13806:1876219121488640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302250.290529:0:13806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302250.290577:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302250.292945:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121488640 00000100:00100000:0.0:1789302250.292967:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121488640 00000100:00100000:0.0:1789302250.293053:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789302250.293066:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+22:13806:x1876219121488640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302250.293323:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+22:13806:x1876219121488640:12345-0@lo:502:llog_process_th.0 Request processed in 257us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302250.293331:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789302250.295618:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13806:1876219121488640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302250.295686:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302250.295700:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302250.295715:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789302250.295721:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789302250.296014:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789302250.296056:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302250.296071:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.296084:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302250.296097:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789302250.296101:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b511e800 from 7 10000000:01000000:0.0:1789302250.296104:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302250.296201:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.296211:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.296222:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302250.296248:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121488768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302250.296331:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302250.296371:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383b08b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302250.296587:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121488768 00000100:00100000:1.0:1789302250.296596:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121488768 00000100:00100000:1.0:1789302250.296646:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789302250.296656:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+22:6527:x1876219121488768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302250.296672:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302250.296687:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd3995b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3995af expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302250.296727:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd3995b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3995af expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302250.296752:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd3995b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3995af expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302250.296762:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2000, rc 0) 00000100:00100000:1.0:1789302250.296817:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121488768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.296825:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789302250.297086:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121488768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302250.297102:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302250.297153:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302250.297231:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121488896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302250.297263:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302250.297288:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382912480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302250.297360:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121488896 00000100:00100000:1.0:1789302250.297365:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121488896 00000100:00100000:1.0:1789302250.297396:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789302250.297403:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121488896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.297546:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121488896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.297554:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789302250.298192:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121488896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302250.298239:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121489024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302250.298306:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302250.298338:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382912480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302250.298793:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121489024 00000100:00100000:1.0:1789302250.298801:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121489024 00000100:00100000:1.0:1789302250.298864:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789302250.298873:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121489024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.299013:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121489024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.299022:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789302250.301051:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121489024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302250.301872:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13808:1876219121489152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302250.301977:0:13808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302250.302028:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829120c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302250.302226:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121489152 00000100:00100000:0.0:1789302250.302235:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121489152 00000100:00100000:0.0:1789302250.302297:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789302250.302308:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:13808:x1876219121489152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302250.302471:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+23:13808:x1876219121489152:12345-0@lo:502:llog_process_th.0 Request processed in 165us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302250.302480:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789302250.303227:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13808:1876219121489152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789302250.303271:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302250.303283:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302250.303286:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789302250.303293:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc4b511e800 00000020:00000080:2.0:1789302250.303296:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789302250.303366:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302250.303369:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302250.303371:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789302250.303373:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302250.303375:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302250.303383:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789302250.303387:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc4b511e800 00000020:00000080:2.0:1789302250.303389:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789302250.303434:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13808:1876219121489280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302250.303496:0:13808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302250.303568:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302250.314315:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121489280 00000100:00100000:1.0:1789302250.314338:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121489280 00000100:00100000:1.0:1789302250.314434:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789302250.314458:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:13808:x1876219121489280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302250.314723:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+23:13808:x1876219121489280:12345-0@lo:502:llog_process_th.0 Request processed in 278us (11226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.314741:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789302250.315267:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13808:1876219121489280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302250.315317:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302250.315327:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302250.315330:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789302250.315336:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789302250.315554:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789302250.315589:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302250.315603:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.315617:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302250.315632:0:6527:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789302250.315635:0:6527:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b863d000 from 7 10000000:01000000:0.0:1789302250.315638:0:6527:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302250.315678:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.315687:0:6527:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302250.315698:0:6527:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302250.315790:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121489408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302250.315926:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302250.315971:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0c9db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302250.317041:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121489408 00000100:00100000:1.0:1789302250.317057:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121489408 00000100:00100000:1.0:1789302250.317146:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789302250.317158:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+23:6527:x1876219121489408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302250.317178:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302250.317201:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd3995c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd3995bd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302250.317237:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd3995c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd3995bd expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302250.317251:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd3995c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd3995bd expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302250.317262:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3400, rc 0) 00000100:00100000:1.0:1789302250.317347:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121489408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.317355:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789302250.317476:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121489408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302250.317498:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302250.317511:0:6527:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302250.317602:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121489536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302250.317641:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302250.317682:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789302250.317735:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121489536 00000100:00100000:1.0:1789302250.317740:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121489536 00000100:00100000:1.0:1789302250.317775:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789302250.317783:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121489536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.319084:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121489536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1292us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.319096:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789302250.319238:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121489536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302250.319296:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121489664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302250.319352:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302250.319395:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0c9db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302250.321402:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121489664 00000100:00100000:1.0:1789302250.321443:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121489664 00000100:00100000:1.0:1789302250.321535:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789302250.321547:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121489664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.321770:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:6527:x1876219121489664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.321779:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789302250.322028:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:483e1a3c-0199-48dd-94ee-f480825c6196:6527:1876219121489664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302250.322345:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13810:1876219121489792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302250.322403:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302250.322433:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121489792 00000100:00100000:1.0:1789302250.322438:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121489792 00000100:00100000:1.0:1789302250.322673:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789302250.322682:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48534b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:13810:x1876219121489792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302250.322800:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48534b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:13810:x1876219121489792:12345-0@lo:502:llog_process_th.0 Request processed in 118us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.322808:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789302250.330491:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc488765c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302250.330550:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13810:1876219121489792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302250.330611:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302250.330625:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302250.330627:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789302250.330635:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc4b863d000 00000020:00000080:1.0:1789302250.330639:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789302250.330978:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302250.330984:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302250.330986:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789302250.330990:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302250.331003:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302250.331004:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789302250.331009:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc4b863d000 00000020:00000080:1.0:1789302250.331012:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000040:00080000:0.0:1789302250.335017:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789302250.342208:0:13810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13810:1876219121489920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302250.342315:0:13810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302250.342365:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121489920 00000100:00100000:1.0:1789302250.342374:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121489920 00000100:00100000:1.0:1789302250.342436:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789302250.342456:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:13810:x1876219121489920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302250.342589:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:13810:x1876219121489920:12345-0@lo:502:llog_process_th.0 Request processed in 143us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.342597:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789302250.342659:0:13810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc488765c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302250.342684:0:13810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:483e1a3c-0199-48dd-94ee-f480825c6196:13810:1876219121489920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302250.342734:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302250.342742:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302250.342744:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789302250.342749:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789302250.342827:0:6527:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789302250.343010:0:6527:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302250.343023:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302250.343035:0:6527:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302250.372343:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789302250.580473:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302250.580523:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121490048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302250.580620:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302250.580760:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121490048 00000100:00100000:0.0:1789302250.580771:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121490048 00000100:00100000:0.0:1789302250.580845:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789302250.580857:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121490048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302250.580899:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789302250.580973:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121490048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302250.580981:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789302250.581347:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121490048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789302250.837059:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302250.837167:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302250.837184:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101475328 00000100:00100000:3.0:1789302250.837199:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101475328 00000100:00100000:0.0:1789302250.837210:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302250.837273:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302250.837287:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101475840 00000100:00100000:0.0:1789302250.837307:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302250.837311:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101475840 00000100:00100000:3.0:1789302250.837350:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101475456 00000100:00100000:0.0:1789302250.837352:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302250.837413:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101475712 00000100:00100000:0.0:1789302250.837422:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101475712 00000100:00100000:0.0:1789302250.837492:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 241 00000100:00100000:0.0:1789302250.837504:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101475328:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302250.837531:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 242 00000100:00100000:2.0:1789302250.837546:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101475840:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302250.837594:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101475456 00000100:00100000:3.0:1789302250.837638:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 243 00000100:00100000:3.0:1789302250.837648:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101475712:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302250.837716:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101475328:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 99us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302250.837728:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 241 00000100:00100000:0.0:1789302250.837754:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 244 00000100:00100000:0.0:1789302250.837764:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101475456:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302250.838339:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101475584 00000100:00100000:1.0:1789302250.838347:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101475584 00000100:00100000:1.0:1789302250.838401:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111 00000100:00100000:1.0:1789302250.838410:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101475584:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302250.841671:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101475840:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 4112us (4449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302250.841691:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 242 00000100:00100000:2.0:1789302250.842000:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101475200 00000100:00100000:2.0:1789302250.842012:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101475200 00000100:00100000:2.0:1789302250.842074:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 374 00000100:00100000:2.0:1789302250.842084:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4883a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101475200:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302250.842169:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4883a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101475200:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 85us (4896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302250.842177:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 374 00000100:00100000:3.0:1789302250.842243:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101475712:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 4585us (4881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302250.842260:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 243 00000100:00080000:2.0:1789302250.842301:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302250.842312:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302250.842316:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302250.843150:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101475456:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 5380us (5838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302250.843163:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 244 00000100:00100000:1.0:1789302250.844541:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101475584:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 5529us (6827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302250.844564:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111 00010000:00010000:2.0:1789302250.901343:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302251.355824:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789302251.413099:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789302251.924405:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302252.948414:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302253.140557:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121490176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302253.140666:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302253.140925:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121490176 00000100:00100000:0.0:1789302253.140943:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121490176 00000100:00100000:0.0:1789302253.141029:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789302253.141052:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121490176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302253.141089:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302253.141176:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121490176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302253.141184:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1789302253.141894:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302253.141954:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121490176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302253.144150:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302253.144181:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121490304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302253.144283:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302253.145546:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121490304 00000100:00100000:1.0:1789302253.145562:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121490304 00000100:00100000:1.0:1789302253.145678:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789302253.145690:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121490304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789302253.145735:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302253.145835:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121490304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302253.145843:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789302253.145977:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121490304:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789302253.147883:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789302253.666680:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:2.0:1789302253.978411:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302254.677133:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121490560:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.677229:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302254.677302:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121491072:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.677339:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302254.677362:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121491584:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.677405:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302254.677456:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789302254.677463:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121490688:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.677491:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302254.677508:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121491200:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.677531:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302254.677552:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121491712:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.677586:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302254.677625:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121490560 00000100:00100000:3.0:1789302254.677634:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121490560 00000100:00100000:3.0:1789302254.677678:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121491072 00000100:00100000:3.0:1789302254.677681:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121491072 00000100:00100000:3.0:1789302254.677704:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121491584 00000100:00100000:3.0:1789302254.677707:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121491584 00000100:00100000:3.0:1789302254.677719:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121491200 00000100:00100000:3.0:1789302254.677722:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121491200 00000100:00100000:3.0:1789302254.677736:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121491712 00000100:00100000:3.0:1789302254.677738:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121491712 00000100:00100000:3.0:1789302254.677754:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789302254.677763:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121490560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.677821:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121490560:12345-0@lo:400:kworker.0 Request processed in 58us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302254.677829:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789302254.677847:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789302254.677853:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121491072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.677878:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121491072:12345-0@lo:400:kworker.0 Request processed in 25us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302254.677884:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789302254.677894:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789302254.677907:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121491584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.677935:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121491584:12345-0@lo:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302254.677941:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789302254.677951:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789302254.677957:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121491200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.677984:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121491200:12345-0@lo:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302254.677990:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789302254.677999:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789302254.678006:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121491712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.678031:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121491712:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302254.678036:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:3.0:1789302254.678058:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789302254.678062:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789302254.678094:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485dd3100 x1876219121491200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302254.678109:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121491200:0@lo:400:kworker.0 00010000:00080000:3.0:1789302254.678154:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485dd0e00 x1876219121491712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302254.678161:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121491712:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.678170:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121490560:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.678178:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121491072:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.678199:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121491584:0@lo:400:kworker.0 00000100:00100000:2.0:1789302254.678797:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121490432:0@lo:400:kworker.0 00000100:00100000:2.0:1789302254.678855:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302254.678901:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121490944:0@lo:400:kworker.0 00000100:00100000:2.0:1789302254.678936:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302254.678964:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121491456:0@lo:400:kworker.0 00000100:00100000:2.0:1789302254.678993:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302254.679016:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121491968:0@lo:400:kworker.0 00000100:00100000:2.0:1789302254.679041:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302254.679067:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789302254.679074:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121490816:0@lo:400:kworker.0 00000100:00100000:2.0:1789302254.679103:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302254.679144:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121491328:0@lo:400:kworker.0 00000100:00100000:2.0:1789302254.679167:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302254.679186:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121491840:0@lo:400:kworker.0 00000100:00100000:2.0:1789302254.679208:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302254.679245:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121490816 00000100:00100000:2.0:1789302254.679252:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121490816 00000100:00100000:2.0:1789302254.679318:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789302254.679327:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121490816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302254.679372:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121490816:12345-0@lo:400:kworker.0 Request processed in 47us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302254.679379:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789302254.679405:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121491456 00000100:00100000:2.0:1789302254.679409:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121491456 00000100:00100000:1.0:1789302254.679617:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121490432 00000100:00100000:1.0:1789302254.679623:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121490432 00000100:00100000:1.0:1789302254.679664:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789302254.679672:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4883a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121490432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302254.679728:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4883a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121490432:12345-0@lo:400:kworker.0 Request processed in 57us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302254.679736:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789302254.679768:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121491968 00000100:00100000:1.0:1789302254.679771:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121491968 00000100:00080000:1.0:1789302254.679792:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302254.679971:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121490688 00000100:00100000:0.0:1789302254.679976:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121490688 00000100:00100000:0.0:1789302254.680011:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121490944 00000100:00100000:0.0:1789302254.680018:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121490944 00000100:00100000:0.0:1789302254.680035:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789302254.680042:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121490688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302254.680096:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121490688:12345-0@lo:400:kworker.0 Request processed in 55us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302254.680103:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789302254.680139:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789302254.680146:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121490944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302254.680175:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121490944:12345-0@lo:400:kworker.0 Request processed in 30us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302254.680181:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789302254.680545:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121490688:0@lo:400:kworker.0 00000100:00100000:0.0:1789302254.680627:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121491328 00000100:00100000:0.0:1789302254.680631:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121491328 00000100:00100000:2.0:1789302254.680703:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121491840 00000100:00100000:2.0:1789302254.680708:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121491840 00000100:00100000:3.0:1789302254.681187:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302254.681202:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121492096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302254.681258:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302254.681314:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121492096 00000100:00100000:3.0:1789302254.681319:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121492096 00000100:00100000:3.0:1789302254.681354:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789302254.681363:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121492096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789302254.681394:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302254.681449:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121492096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302254.681456:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789302254.681508:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121492096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302254.681678:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121490816:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.681692:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121490432:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.681701:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121490944:0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.681766:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789302254.681777:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121491456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302254.681822:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121491456:12345-0@lo:400:kworker.0 Request processed in 48us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302254.681829:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1789302254.683185:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302254.683216:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789302254.683237:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121491968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302254.683338:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121491968:12345-0@lo:400:kworker.0 Request processed in 113us (4296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302254.683346:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789302254.692303:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789302254.692330:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cc4b7eee680, transno 4294967301 00000100:00100000:1.0:1789302254.692360:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121491456:0@lo:400:kworker.0 00010000:00080000:1.0:1789302254.692382:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485dd1880 x1876219121491968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302254.692393:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121491968:0@lo:400:kworker.0 00000100:00100000:0.0:1789302254.694674:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789302254.694697:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121491328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302254.694830:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121491328:12345-0@lo:400:kworker.0 Request processed in 143us (15661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302254.694860:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789302254.694958:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121491328:0@lo:400:kworker.0 00000100:00100000:2.0:1789302254.700790:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789302254.700823:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121491840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302254.701005:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121491840:12345-0@lo:400:kworker.0 Request processed in 200us (21795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302254.701013:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:1.0:1789302254.701235:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485dd1180 x1876219121491840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302254.701255:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121491840:0@lo:400:kworker.0 00010000:00010000:3.0:1789302254.999532:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302255.188782:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121492224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302255.188889:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302255.189043:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121492224 00000100:00100000:3.0:1789302255.189054:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121492224 00000100:00100000:3.0:1789302255.189170:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789302255.189180:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121492224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302255.189218:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302255.189278:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121492224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302255.189285:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789302255.189720:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121492352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302255.189763:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789302255.189890:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efdf80 x1876219121492224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302255.189912:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121492224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302255.189945:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121492352 00000100:00100000:0.0:1789302255.189950:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121492352 00000100:00100000:0.0:1789302255.189991:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789302255.189999:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121492352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302255.190012:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302255.190049:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121492352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302255.190055:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1789302255.190154:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f56a00 x1876219121492352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302255.190167:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121492352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302255.700770:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121492480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302255.700871:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302255.701012:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121492480 00000100:00100000:0.0:1789302255.701023:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121492480 00000100:00100000:0.0:1789302255.701079:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789302255.701090:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121492480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302255.701170:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789302255.701237:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121492480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302255.701244:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789302255.701375:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121492480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302255.955583:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302255.955638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302255.955673:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302255.955710:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302255.955738:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302255.955763:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302255.955797:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101475968 00000100:00100000:2.0:1789302255.955811:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101475968 00000100:00100000:2.0:1789302255.955875:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 376 00000100:00100000:2.0:1789302255.955887:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101475968:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302255.955982:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101475968:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 97us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302255.955990:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 376 00000100:00100000:0.0:1789302255.956231:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101476096 00000100:00100000:0.0:1789302255.956254:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101476096 00000100:00100000:0.0:1789302255.956307:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101476608 00000100:00100000:0.0:1789302255.956310:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101476608 00000100:00100000:0.0:1789302255.956325:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101476224 00000100:00100000:0.0:1789302255.956327:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101476224 00000100:00100000:0.0:1789302255.956341:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101476480 00000100:00100000:0.0:1789302255.956344:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101476480 00000100:00100000:0.0:1789302255.956358:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 251 00000100:00100000:0.0:1789302255.956366:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101476096:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302255.956420:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101476096:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 54us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302255.956427:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 251 00000100:00100000:0.0:1789302255.956443:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 252 00000100:00100000:0.0:1789302255.956450:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101476608:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302255.956475:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101476608:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302255.956481:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 252 00000100:00100000:0.0:1789302255.956492:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 253 00000100:00100000:0.0:1789302255.956497:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101476224:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302255.956519:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101476224:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302255.956525:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 253 00000100:00100000:0.0:1789302255.956536:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 254 00000100:00100000:0.0:1789302255.956542:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101476480:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302255.956565:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101476480:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302255.956581:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 254 00000100:00100000:1.0:1789302255.956747:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101476352 00000100:00100000:1.0:1789302255.956752:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101476352 00000100:00100000:1.0:1789302255.956802:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 116 00000100:00100000:1.0:1789302255.956810:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101476352:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302255.956841:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101476352:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 32us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302255.956848:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 116 00000100:00080000:2.0:1789302255.957053:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302255.957059:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302255.957062:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789302256.020898:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302257.048710:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302258.068433:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302258.260444:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121492608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789302258.260546:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302258.260802:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121492608 00000100:00100000:1.0:1789302258.260810:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121492608 00000100:00100000:1.0:1789302258.260874:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789302258.260884:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121492608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789302258.260915:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302258.260963:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121492608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302258.260969:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1789302258.261029:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302258.261065:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121492608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789302258.261218:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121492736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302258.261249:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302258.261364:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121492736 00000100:00100000:0.0:1789302258.261369:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121492736 00000100:00100000:0.0:1789302258.261417:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789302258.261424:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121492736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302258.261434:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302258.261467:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121492736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302258.261473:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1789302258.261520:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302258.261543:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121492736:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789302259.092562:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302259.796393:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121492864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302259.796470:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302259.796542:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302259.796550:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121492992:0@lo:400:kworker.0 00000100:00100000:2.0:1789302259.796581:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.810727:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121493120:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.810809:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.810842:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121493632:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.810863:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.810878:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121494144:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.810897:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.810918:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789302259.810924:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121493248:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.810947:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.810964:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121493760:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811004:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.811025:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121494272:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811047:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.811079:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121493120 00000100:00100000:0.0:1789302259.811086:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121493120 00000100:00100000:0.0:1789302259.811150:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121493632 00000100:00100000:0.0:1789302259.811160:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121493632 00000100:00100000:0.0:1789302259.811188:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121494144 00000100:00100000:0.0:1789302259.811190:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121494144 00000100:00100000:0.0:1789302259.811208:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789302259.811216:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121493120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811266:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121493120:12345-0@lo:400:kworker.0 Request processed in 51us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.811273:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789302259.811300:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789302259.811308:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121493632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811335:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121493632:12345-0@lo:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.811340:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789302259.811363:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789302259.811369:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121494144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811419:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121494144:12345-0@lo:400:kworker.0 Request processed in 50us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.811425:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789302259.811450:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121492864 00000100:00100000:0.0:1789302259.811454:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121492864 00000100:00100000:0.0:1789302259.811474:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121493248 00000100:00100000:0.0:1789302259.811476:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121493248 00000100:00100000:0.0:1789302259.811487:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789302259.811493:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121492864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789302259.811517:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789302259.811549:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121492864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (15080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.811565:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789302259.811577:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789302259.811583:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121493248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811612:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121493248:12345-0@lo:400:kworker.0 Request processed in 29us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.811618:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789302259.811636:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121493760 00000100:00100000:0.0:1789302259.811639:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121493760 00000100:00100000:0.0:1789302259.811663:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121494272 00000100:00100000:0.0:1789302259.811666:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121494272 00000100:00100000:0.0:1789302259.811685:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789302259.811692:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121493760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811720:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121493760:12345-0@lo:400:kworker.0 Request processed in 29us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.811726:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789302259.811737:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789302259.811743:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121494272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811769:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121494272:12345-0@lo:400:kworker.0 Request processed in 27us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.811775:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789302259.811812:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121493248:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811824:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121493760:0@lo:400:kworker.0 00010000:00080000:0.0:1789302259.811836:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f75f80 x1876219121494272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302259.811846:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121494272:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811864:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121493120:0@lo:400:kworker.0 00010000:00080000:0.0:1789302259.811873:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d53100 x1876219121493632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302259.811881:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121493632:0@lo:400:kworker.0 00010000:00080000:0.0:1789302259.811889:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f77b80 x1876219121494144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302259.811896:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121494144:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811939:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121493504:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.811965:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.811983:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121494016:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812001:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.812018:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789302259.812024:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121493376:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812043:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.812055:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121493888:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812073:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.812088:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121494400:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812107:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302259.812156:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121493888 00000100:00100000:0.0:1789302259.812160:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121493888 00000100:00100000:0.0:1789302259.812176:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121494400 00000100:00100000:0.0:1789302259.812179:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121494400 00000100:00100000:0.0:1789302259.812192:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789302259.812198:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121493888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812241:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121493888:12345-0@lo:400:kworker.0 Request processed in 42us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.812247:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789302259.812258:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789302259.812263:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121494400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812288:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121494400:12345-0@lo:400:kworker.0 Request processed in 25us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.812293:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789302259.812308:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121493504 00000100:00100000:0.0:1789302259.812311:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121493504 00000100:00100000:0.0:1789302259.812328:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121494016 00000100:00100000:0.0:1789302259.812330:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121494016 00000100:00100000:0.0:1789302259.812340:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121493376 00000100:00100000:0.0:1789302259.812342:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121493376 00000100:00100000:0.0:1789302259.812353:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789302259.812359:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121493504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812400:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121493504:12345-0@lo:400:kworker.0 Request processed in 41us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.812405:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789302259.812417:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789302259.812423:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121494016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812449:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121494016:12345-0@lo:400:kworker.0 Request processed in 27us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.812455:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789302259.812465:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789302259.812471:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121493376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812507:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121493376:12345-0@lo:400:kworker.0 Request processed in 36us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302259.812513:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789302259.812543:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121493376:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812552:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121493888:0@lo:400:kworker.0 00010000:00080000:0.0:1789302259.812560:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bd802a00 x1876219121494400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302259.812569:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121494400:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812577:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121493504:0@lo:400:kworker.0 00000100:00100000:0.0:1789302259.812586:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121494016:0@lo:400:kworker.0 00000100:00080000:2.0:1789302259.813664:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302259.813673:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302259.813676:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789302259.813723:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121492864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302259.819758:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121492992 00000100:00100000:3.0:1789302259.819786:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121492992 00000100:00100000:3.0:1789302259.819858:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789302259.819869:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121492992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302259.819975:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121492992:12345-0@lo:400:kworker.0 Request processed in 108us (23393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302259.819982:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789302259.820575:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121492992:0@lo:400:kworker.0 00010000:00010000:1.0:1789302260.116639:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302260.308305:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302260.308327:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121494528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302260.308403:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302260.308480:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121494528 00000100:00100000:1.0:1789302260.308487:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121494528 00000100:00100000:1.0:1789302260.308531:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789302260.308962:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121494656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302260.308994:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302260.309070:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121494656 00000100:00100000:0.0:1789302260.309075:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121494656 00000100:00100000:0.0:1789302260.309096:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789302260.309102:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121494656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302260.309153:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302260.309201:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121494656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302260.309218:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:2.0:1789302260.309345:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4adc8d880 x1876219121494656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302260.309363:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121494656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302260.309627:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121494528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302260.309642:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302260.309683:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121494528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1143us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302260.309707:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1789302260.309835:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7efea00 x1876219121494528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302260.309850:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121494528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302260.821384:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302260.821408:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121494784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302260.821480:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302260.822084:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121494784 00000100:00100000:0.0:1789302260.822094:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121494784 00000100:00100000:0.0:1789302260.822182:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789302260.822192:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121494784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302260.822225:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789302260.822288:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121494784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302260.822294:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789302260.822668:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121494784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302261.079148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302261.079192:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302261.079240:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302261.079504:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101476736 00000100:00100000:1.0:1789302261.079514:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101476736 00000100:00100000:2.0:1789302261.079554:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302261.079787:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 378 00000100:00100000:1.0:1789302261.079798:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101476736:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302261.079867:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101476736:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 70us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302261.079875:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 378 00000100:00100000:2.0:1789302261.087983:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302261.088018:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302261.093872:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101476992 00000100:00100000:3.0:1789302261.093887:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101476992 00000100:00100000:3.0:1789302261.093967:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101477248 00000100:00100000:3.0:1789302261.093971:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101477248 00000100:00100000:3.0:1789302261.093987:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101476864 00000100:00100000:3.0:1789302261.093990:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101476864 00000100:00100000:3.0:1789302261.094016:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 261 00000100:00100000:3.0:1789302261.094027:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101476992:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302261.097189:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 262 00000100:00100000:0.0:1789302261.097214:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101477248:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302261.097319:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101477248:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 116us (18076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302261.097326:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 262 00000100:00100000:0.0:1789302261.097347:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 263 00000100:00100000:0.0:1789302261.097354:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101476864:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302261.097391:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101476864:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 37us (17837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302261.097396:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 263 00000100:00080000:0.0:1789302261.097562:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302261.097568:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789302261.097581:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101477120 00000100:00100000:0.0:1789302261.097589:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101477120 00000100:00100000:0.0:1789302261.097633:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 121 00000100:00100000:0.0:1789302261.097640:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101477120:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302261.097681:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101477120:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 41us (9706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302261.097700:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 121 00000100:00080000:0.0:1789302261.097732:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302261.098289:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101476992:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 4261us (19093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302261.098304:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 261 00000100:00100000:0.0:1789302261.101520:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101477376 00000100:00100000:0.0:1789302261.101536:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101477376 00000100:00100000:0.0:1789302261.101623:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 264 00000100:00100000:0.0:1789302261.101634:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101477376:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302261.101709:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101477376:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 76us (13689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302261.101965:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 264 00000100:00080000:2.0:1789302261.102892:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789302261.141815:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789302261.589626:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789302261.653348:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789302262.164348:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302263.188275:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302263.380511:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121494912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789302263.380597:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302263.380721:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121494912 00000100:00100000:3.0:1789302263.380730:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121494912 00000100:00100000:3.0:1789302263.380794:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789302263.380806:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121494912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789302263.380834:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302263.380891:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121494912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302263.380898:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789302263.380926:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121495040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302263.380966:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789302263.380970:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302263.381039:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121495040 00000100:00100000:3.0:1789302263.381044:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121495040 00000100:00100000:3.0:1789302263.381092:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789302263.381098:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121495040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789302263.381109:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302263.381166:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121495040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302263.381172:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1789302263.381536:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302263.381568:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121495040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302263.390193:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121494912:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789302264.214243:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302264.916471:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302264.916493:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121495168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302264.916563:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302264.916729:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121495168 00000100:00100000:3.0:1789302264.916737:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121495168 00000100:00100000:3.0:1789302264.916794:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789302264.916803:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121495168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789302264.916836:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302264.916906:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121495168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302264.916914:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789302264.917063:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121495168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302264.917291:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121495552:0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.917322:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302264.917325:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121495680:0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.917338:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121496064:0@lo:400:kworker.0 00000100:00100000:2.0:1789302264.917365:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302264.917368:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302264.917382:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121496192:0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.917394:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121496576:0@lo:400:kworker.0 00000100:00100000:2.0:1789302264.917402:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302264.917417:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121496064 00000100:00100000:1.0:1789302264.917422:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121496064 00000100:00100000:1.0:1789302264.917448:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121496192 00000100:00100000:3.0:1789302264.917449:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121495552 00000100:00100000:3.0:1789302264.917451:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121495552 00000100:00100000:1.0:1789302264.917451:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121496192 00000100:00100000:1.0:1789302264.917466:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789302264.917468:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789302264.917473:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121495552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.917473:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121496064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302264.917536:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121495680 00000100:00100000:0.0:1789302264.917541:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121495680 00000100:00100000:0.0:1789302264.917568:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789302264.917573:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121495680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.920144:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121496064:12345-0@lo:400:kworker.0 Request processed in 2662us (2764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302264.920158:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789302264.920198:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789302264.920210:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121496192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.920256:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121496192:12345-0@lo:400:kworker.0 Request processed in 50us (2852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302264.920262:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789302264.920488:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121495296:0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.920529:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302264.920565:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121495808:0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.920612:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302264.920637:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121496320:0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.920660:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302264.923025:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121495424:0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.923096:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302264.923144:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121495936:0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.923168:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302264.923180:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121496448:0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.923200:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302264.923230:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302264.923276:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121496064:0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.923311:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121496576 00000100:00100000:1.0:1789302264.923318:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121496576 00000100:00100000:1.0:1789302264.923397:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789302264.923406:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121496576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.923458:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121496576:12345-0@lo:400:kworker.0 Request processed in 53us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302264.923464:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1789302264.923484:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302264.923497:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121495808 00000100:00100000:1.0:1789302264.923500:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121495808 00000100:00100000:1.0:1789302264.923523:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121496320 00000100:00100000:1.0:1789302264.923526:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121496320 00000100:00100000:1.0:1789302264.923538:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121495424 00000100:00100000:1.0:1789302264.923540:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121495424 00000100:00100000:1.0:1789302264.923549:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121495936 00000100:00100000:1.0:1789302264.923551:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121495936 00000100:00100000:1.0:1789302264.923564:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121496448 00000100:00100000:1.0:1789302264.923566:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121496448 00000100:00100000:1.0:1789302264.923579:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789302264.923584:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121495808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.923618:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121495808:12345-0@lo:400:kworker.0 Request processed in 33us (3006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302264.923624:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789302264.923635:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789302264.923640:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121496320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.923665:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121496320:12345-0@lo:400:kworker.0 Request processed in 24us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302264.923671:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789302264.923716:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121495552:12345-0@lo:400:kworker.0 Request processed in 6240us (6392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302264.923725:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789302264.923750:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789302264.923757:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121495424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302264.923794:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121495424:12345-0@lo:400:kworker.0 Request processed in 37us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302264.923800:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789302264.923815:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789302264.923821:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121495936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302264.923846:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121495936:12345-0@lo:400:kworker.0 Request processed in 27us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302264.923852:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789302264.923864:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789302264.923870:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121496448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302264.923895:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121496448:12345-0@lo:400:kworker.0 Request processed in 25us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302264.923900:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789302264.924051:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121495424:0@lo:400:kworker.0 00010000:00080000:3.0:1789302264.924074:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4adc8ad80 x1876219121495936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302264.924085:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121495936:0@lo:400:kworker.0 00010000:00080000:3.0:1789302264.924095:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bdbbe300 x1876219121496448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302264.924104:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121496448:0@lo:400:kworker.0 00000100:00100000:3.0:1789302264.924373:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121495296 00000100:00100000:3.0:1789302264.924378:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121495296 00000100:00100000:3.0:1789302264.924407:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789302264.924414:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121495296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302264.924451:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121495296:12345-0@lo:400:kworker.0 Request processed in 38us (3922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302264.924458:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00080000:3.0:1789302264.924506:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789302264.924511:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302264.924530:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121495552:0@lo:400:kworker.0 00010000:00080000:3.0:1789302264.924542:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bdbbf480 x1876219121496576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302264.924552:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121496576:0@lo:400:kworker.0 00000100:00100000:3.0:1789302264.924581:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121495296:0@lo:400:kworker.0 00000100:00100000:3.0:1789302264.924591:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121495808:0@lo:400:kworker.0 00000100:00100000:3.0:1789302264.924601:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121496320:0@lo:400:kworker.0 00000100:00100000:0.0:1789302264.926544:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121495680:12345-0@lo:400:kworker.0 Request processed in 8962us (9169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302264.926556:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789302264.936452:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121496192:0@lo:400:kworker.0 00000100:00100000:2.0:1789302264.936469:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121496704:0@lo:400:kworker.0 00000100:00100000:2.0:1789302264.936525:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302264.936580:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121495680:0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.936650:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121496704 00000100:00100000:1.0:1789302264.936657:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121496704 00000100:00100000:1.0:1789302264.936736:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789302264.936758:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121496704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302264.936811:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121496704:12345-0@lo:400:kworker.0 Request processed in 55us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302264.936818:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1789302264.936868:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789302264.937053:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bdbbd880 x1876219121496704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302264.937066:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121496704:0@lo:400:kworker.0 00010000:00010000:3.0:1789302265.236354:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302265.428333:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302265.428362:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121496832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302265.428427:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302265.428588:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121496832 00000100:00100000:1.0:1789302265.428597:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121496832 00000100:00100000:1.0:1789302265.428656:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789302265.428665:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121496832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302265.428692:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302265.428730:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121496832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302265.428736:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:0.0:1789302265.428937:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc484fe2300 x1876219121496832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302265.428955:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121496832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302265.429015:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302265.429037:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121496960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302265.429065:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302265.429250:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121496960 00000100:00100000:0.0:1789302265.429254:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121496960 00000100:00100000:0.0:1789302265.429285:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789302265.429291:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121496960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302265.429302:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302265.429334:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121496960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302265.429351:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:0.0:1789302265.429374:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4adc8c380 x1876219121496960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302265.429386:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121496960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302265.940751:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121497088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302265.940822:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302265.940952:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121497088 00000100:00100000:0.0:1789302265.940961:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121497088 00000100:00100000:0.0:1789302265.941012:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789302265.941022:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121497088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302265.941055:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789302265.941130:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121497088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302265.941137:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789302265.941181:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121497088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789302266.200260:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302266.200303:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302266.200361:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302266.200458:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101477760 00000100:00100000:2.0:1789302266.200459:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101477632 00000100:00100000:3.0:1789302266.200470:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101477760 00000100:00100000:2.0:1789302266.200470:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101477632 00000100:00100000:1.0:1789302266.200541:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101477504 00000100:00100000:1.0:1789302266.200547:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101477504 00000100:00100000:1.0:1789302266.200593:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 380 00000100:00100000:1.0:1789302266.200602:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101477504:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302266.200670:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101477504:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 68us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302266.200678:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 380 00000100:00100000:2.0:1789302266.200888:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 271 00000100:00100000:2.0:1789302266.200896:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101477632:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302266.200936:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101477632:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 41us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302266.200952:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 271 00000100:00080000:0.0:1789302266.201972:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302266.201980:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302266.203617:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 272 00000100:00100000:3.0:1789302266.203632:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101477760:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302266.203786:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101477760:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 158us (3480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302266.203794:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 272 00000100:00100000:1.0:1789302266.219038:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302266.219081:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302266.219165:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302266.219313:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101478016 00000100:00100000:2.0:1789302266.219324:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101478016 00000100:00100000:3.0:1789302266.219331:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101477888 00000100:00100000:3.0:1789302266.219347:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101477888 00000100:00100000:0.0:1789302266.219407:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101478144 00000100:00100000:0.0:1789302266.219411:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101478144 00000100:00100000:2.0:1789302266.219476:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 273 00000100:00100000:2.0:1789302266.219485:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101478016:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302266.219548:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101478016:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 64us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302266.219555:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 273 00000100:00100000:3.0:1789302266.222207:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 27 00000100:00100000:3.0:1789302266.222223:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2395:x1876219101477888:12345-192.168.203.9@tcp:9:kworker.0 00000020:00000080:3.0:1789302266.222356:0:8445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3994eb 00000100:00080000:3.0:1789302266.222368:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cc38401f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789302266.222417:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1789302266.222672:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+2:2395:x1876219101477888:12345-192.168.203.9@tcp:9:kworker.0 Request processed in 453us (3505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302266.222681:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 27 00000100:00100000:0.0:1789302266.222956:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 274 00000100:00100000:0.0:1789302266.222965:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101478144:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302266.223003:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101478144:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 39us (3921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302266.223010:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 274 00010000:00010000:0.0:1789302266.223073:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789302266.231123:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302266.234757:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302266.234767:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789302266.266052:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302267.284515:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302268.315583:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302268.500502:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302268.500526:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121497216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302268.500593:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302268.500805:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121497216 00000100:00100000:0.0:1789302268.500814:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121497216 00000100:00100000:0.0:1789302268.500880:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789302268.500891:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121497216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302268.500918:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302268.500959:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121497216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302268.500966:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789302268.501051:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121497216:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789302268.501243:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302268.502468:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121497344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302268.502537:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302268.502638:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121497344 00000100:00100000:1.0:1789302268.502645:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121497344 00000100:00100000:1.0:1789302268.502715:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789302268.502732:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121497344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789302268.502750:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302268.502792:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121497344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302268.502799:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789302268.502919:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121497344:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789302268.503054:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789302269.333650:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302270.040750:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121497472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302270.040823:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302270.043174:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121497472 00000100:00100000:1.0:1789302270.043185:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121497472 00000100:00100000:1.0:1789302270.043322:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789302270.043333:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121497472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789302270.043368:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789302270.043614:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121497600:0@lo:400:kworker.0 00000100:00100000:2.0:1789302270.043660:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302270.043733:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121497728:0@lo:400:kworker.0 00000100:00100000:2.0:1789302270.043761:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302270.043801:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302270.043807:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121497856:0@lo:400:kworker.0 00000100:00100000:2.0:1789302270.043830:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302270.043850:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121497856 00000100:00100000:2.0:1789302270.043854:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121497856 00000100:00100000:2.0:1789302270.043878:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789302270.043884:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121497856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302270.043921:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121497856:12345-0@lo:400:kworker.0 Request processed in 36us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302270.043927:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789302270.043962:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121497856:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044087:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121497600 00000100:00100000:3.0:1789302270.044091:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121497600 00000100:00100000:3.0:1789302270.044135:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789302270.044142:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121497600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044176:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121497600:12345-0@lo:400:kworker.0 Request processed in 35us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302270.044183:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789302270.044255:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121498240:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044277:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302270.044306:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121497728 00000100:00100000:3.0:1789302270.044322:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121497728 00000100:00100000:3.0:1789302270.044347:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121498240 00000100:00100000:3.0:1789302270.044350:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121498240 00000100:00100000:3.0:1789302270.044376:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789302270.044382:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121497728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044416:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121497728:12345-0@lo:400:kworker.0 Request processed in 33us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302270.044422:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789302270.044434:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789302270.044440:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121498240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044463:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121498240:12345-0@lo:400:kworker.0 Request processed in 24us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302270.044469:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00080000:3.0:1789302270.044513:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f57800 x1876219121498240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302270.044523:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121498240:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044533:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121497728:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044566:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121498368:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044592:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302270.044642:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121498752:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044663:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302270.044686:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121498752 00000100:00100000:3.0:1789302270.044690:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121498752 00000100:00100000:3.0:1789302270.044712:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789302270.044718:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121498752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044748:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121498752:12345-0@lo:400:kworker.0 Request processed in 30us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302270.044754:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00080000:3.0:1789302270.044780:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f57480 x1876219121498752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302270.044790:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121498752:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044816:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121498880:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044838:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302270.044863:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121498368 00000100:00100000:3.0:1789302270.044866:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121498368 00000100:00100000:3.0:1789302270.044889:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121498880 00000100:00100000:3.0:1789302270.044891:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121498880 00000100:00100000:3.0:1789302270.044909:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789302270.044922:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121498368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.044956:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121498368:12345-0@lo:400:kworker.0 Request processed in 34us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302270.044962:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789302270.044973:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789302270.044979:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121498880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.045018:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121498880:12345-0@lo:400:kworker.0 Request processed in 39us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302270.045024:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:3.0:1789302270.045053:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f57480 x1876219121498880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302270.045063:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121498880:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.045072:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121498368:0@lo:400:kworker.0 00000100:00100000:2.0:1789302270.048802:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121497600:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.048965:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121498112:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.049081:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302270.049199:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121497472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5866us (8373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302270.049210:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1789302270.049282:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302270.049288:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302270.049292:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789302270.049369:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121497472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302270.049467:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121497984:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.049654:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121498624:0@lo:400:kworker.0 00000100:00100000:3.0:1789302270.049681:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302270.049934:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121498112 00000100:00100000:2.0:1789302270.049941:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121498112 00000100:00100000:1.0:1789302270.051090:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121498624 00000100:00100000:1.0:1789302270.051101:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121498624 00000100:00080000:2.0:1789302270.051315:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302270.051334:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789302270.051345:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121498112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302270.051724:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121498112:12345-0@lo:400:kworker.0 Request processed in 380us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302270.051732:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789302270.051758:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302270.051791:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121498496:0@lo:400:kworker.0 00000100:00100000:0.0:1789302270.051819:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302270.051841:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121498496 00000100:00100000:0.0:1789302270.051845:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121498496 00000100:00100000:0.0:1789302270.051876:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789302270.051882:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121498496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302270.051910:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121498496:12345-0@lo:400:kworker.0 Request processed in 29us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302270.051916:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1789302270.051930:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302270.051952:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121498496:0@lo:400:kworker.0 00000100:00100000:0.0:1789302270.051959:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121499008:0@lo:400:kworker.0 00000100:00100000:0.0:1789302270.051978:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302270.051996:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121499008 00000100:00100000:0.0:1789302270.051999:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121499008 00000100:00100000:0.0:1789302270.052027:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789302270.052093:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121497984 00000100:00100000:2.0:1789302270.052098:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121497984 00000100:00100000:2.0:1789302270.052140:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789302270.052147:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121497984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302270.052182:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121497984:12345-0@lo:400:kworker.0 Request processed in 37us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302270.052188:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789302270.052353:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121498112:0@lo:400:kworker.0 00000100:00100000:1.0:1789302270.052545:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789302270.052552:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121498624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302270.054246:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121499008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302270.054329:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121499008:12345-0@lo:400:kworker.0 Request processed in 177us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302270.054354:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1789302270.054403:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302270.054408:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789302270.054443:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7f57800 x1876219121499008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302270.054457:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121499008:0@lo:400:kworker.0 00000100:00100000:0.0:1789302270.054486:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121497984:0@lo:400:kworker.0 00000100:00100000:1.0:1789302270.054688:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121498624:12345-0@lo:400:kworker.0 Request processed in 2134us (5004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302270.054701:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789302270.054738:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121498624:0@lo:400:kworker.0 00010000:00010000:0.0:1789302270.362155:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302270.550458:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121499136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302270.550595:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302270.550674:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121499136 00000100:00100000:2.0:1789302270.550682:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121499136 00000100:00100000:2.0:1789302270.550734:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789302270.550744:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121499136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302270.550774:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302270.550816:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121499136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302270.550822:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:2.0:1789302270.550861:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bdbbc700 x1876219121499136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302270.550880:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121499136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302270.551008:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302270.551018:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121499264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302270.551049:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302270.551083:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121499264 00000100:00100000:0.0:1789302270.551087:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121499264 00000100:00100000:0.0:1789302270.551137:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789302270.551145:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121499264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302270.551156:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302270.551189:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121499264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302270.551195:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:0.0:1789302270.551221:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4adc8c000 x1876219121499264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302270.551233:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121499264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302271.062564:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121499392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789302271.062632:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302271.064522:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121499392 00000100:00100000:2.0:1789302271.064542:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121499392 00000100:00100000:2.0:1789302271.064601:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789302271.064611:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121499392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302271.064646:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789302271.064722:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121499392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302271.064728:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789302271.064777:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121499392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302271.315021:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302271.315068:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302271.315099:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302271.315152:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302271.315179:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302271.315205:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101478528 00000100:00100000:2.0:1789302271.315214:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101478528 00000100:00100000:2.0:1789302271.315268:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101478784 00000100:00100000:2.0:1789302271.315271:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101478784 00000100:00100000:2.0:1789302271.315289:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101478400 00000100:00100000:2.0:1789302271.315292:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101478400 00000100:00100000:2.0:1789302271.315320:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101478656 00000100:00100000:2.0:1789302271.315324:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101478656 00000100:00100000:2.0:1789302271.315343:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 281 00000100:00100000:2.0:1789302271.315353:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101478528:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302271.315432:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101478528:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 81us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302271.315440:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 281 00000100:00100000:2.0:1789302271.315458:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 282 00000100:00100000:2.0:1789302271.315465:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101478784:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302271.315502:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101478784:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 38us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302271.315509:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 282 00000100:00100000:2.0:1789302271.315522:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 283 00000100:00100000:2.0:1789302271.315530:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101478400:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302271.315552:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101478400:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302271.315558:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 283 00000100:00100000:2.0:1789302271.315567:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 284 00000100:00100000:2.0:1789302271.315572:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101478656:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302271.315590:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101478656:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 18us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302271.315595:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 284 00000100:00080000:2.0:1789302271.315615:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302271.315618:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789302271.316293:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101478272 00000100:00100000:1.0:1789302271.316310:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101478272 00000100:00100000:1.0:1789302271.316464:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 382 00000100:00100000:1.0:1789302271.316472:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2397:x1876219101478272:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302271.316524:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2397:x1876219101478272:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 53us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302271.316532:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 382 00010000:00010000:1.0:1789302271.385774:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789302271.829973:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789302271.892724:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1789302272.087173:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:1.0:1789302272.087182:0:8439:0:(genops.c:885:class_export_put()) final put ffff8cc38401d800/c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:1.0:1789302272.087202:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc38401d800/c76ee310-c3b4-4286-aaea-77936c269d98 for lustre-OST0000 00000020:00000080:1.0:1789302272.091442:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc38401f000 for lustre-OST0000 00010000:00010000:3.0:1789302272.413380:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302273.428418:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302273.621859:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121499520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302273.621951:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302273.623306:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121499648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302273.623357:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302273.623569:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121499520 00000100:00100000:0.0:1789302273.623578:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121499520 00000100:00100000:0.0:1789302273.623632:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121499648 00000100:00100000:0.0:1789302273.623645:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121499648 00000100:00100000:0.0:1789302273.623664:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789302273.623671:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121499520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302273.623697:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302273.623737:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121499520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302273.623743:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789302273.623759:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789302273.623765:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121499648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302273.623773:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302273.623797:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121499648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302273.623802:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789302273.623841:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121499648:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789302273.624063:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302273.625838:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121499520:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789302274.460181:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302275.156809:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121499904:0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.156882:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121500160:0@lo:400:kworker.0 00000100:00100000:0.0:1789302275.156895:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302275.156961:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121499776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302275.157024:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121500032:0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.160109:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302275.160213:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121500672:0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.160259:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302275.160397:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121501184:0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.160472:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302275.160523:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121500160 00000100:00100000:1.0:1789302275.160530:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121500160 00000100:00100000:1.0:1789302275.160572:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789302275.160580:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121500160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.160637:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121500160:12345-0@lo:400:kworker.0 Request processed in 57us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302275.160643:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789302275.160664:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121500672 00000100:00100000:1.0:1789302275.160669:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121500672 00000100:00100000:1.0:1789302275.160702:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121501184 00000100:00100000:1.0:1789302275.160705:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121501184 00000100:00100000:1.0:1789302275.160752:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789302275.160763:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121500672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.160795:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121500672:12345-0@lo:400:kworker.0 Request processed in 38us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302275.160801:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789302275.160813:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789302275.160820:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121501184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.160846:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121501184:12345-0@lo:400:kworker.0 Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302275.160851:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:1.0:1789302275.160870:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789302275.160900:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121500160:0@lo:400:kworker.0 00010000:00080000:1.0:1789302275.160912:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc484fe1f80 x1876219121500672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302275.160922:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121500672:0@lo:400:kworker.0 00010000:00080000:1.0:1789302275.160931:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4adc8a680 x1876219121501184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302275.160939:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121501184:0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.161066:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121499904 00000100:00100000:1.0:1789302275.161071:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121499904 00000100:00100000:1.0:1789302275.161097:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789302275.161104:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121499904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.161155:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121499904:12345-0@lo:400:kworker.0 Request processed in 51us (4262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302275.161169:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789302275.161636:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302275.161668:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121499776 00000100:00100000:2.0:1789302275.161672:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121499776 00000100:00100000:2.0:1789302275.161701:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789302275.161709:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121499776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302275.161743:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302275.161879:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302275.161924:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121500544:0@lo:400:kworker.0 00000100:00100000:3.0:1789302275.161951:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302275.161973:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121500032 00000100:00100000:3.0:1789302275.161977:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121500032 00000100:00100000:3.0:1789302275.162000:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121500544 00000100:00100000:3.0:1789302275.162003:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121500544 00000100:00100000:3.0:1789302275.162027:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789302275.162033:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121500032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302275.162065:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121500032:12345-0@lo:400:kworker.0 Request processed in 33us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302275.162071:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789302275.162086:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789302275.162092:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121500544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302275.162136:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121500544:12345-0@lo:400:kworker.0 Request processed in 44us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302275.162142:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:3.0:1789302275.162161:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302275.162736:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121499904:0@lo:400:kworker.0 00000100:00100000:0.0:1789302275.162763:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121500416:0@lo:400:kworker.0 00000100:00100000:0.0:1789302275.162809:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302275.162839:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121500928:0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.162856:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121500416 00000100:00100000:1.0:1789302275.162863:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121500416 00000100:00100000:0.0:1789302275.162869:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302275.162897:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789302275.162906:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121500416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302275.162913:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121500928 00000100:00100000:0.0:1789302275.162923:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121500928 00000100:00100000:0.0:1789302275.162962:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789302275.162969:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121500928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302275.165606:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121500544:0@lo:400:kworker.0 00000100:00100000:3.0:1789302275.165622:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121501056:0@lo:400:kworker.0 00000100:00100000:0.0:1789302275.165726:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121500928:12345-0@lo:400:kworker.0 Request processed in 2755us (2854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302275.165740:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121500416:12345-0@lo:400:kworker.0 Request processed in 2833us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302275.165741:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1789302275.165804:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302275.165824:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789302275.165838:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121500928:0@lo:400:kworker.0 00000100:00100000:0.0:1789302275.165848:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121501440:0@lo:400:kworker.0 00000100:00100000:0.0:1789302275.165888:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302275.165941:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121500416:0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.167667:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121501440 00000100:00100000:1.0:1789302275.167680:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121501440 00000100:00100000:1.0:1789302275.167822:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789302275.167835:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121501440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.167914:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121501440:12345-0@lo:400:kworker.0 Request processed in 83us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302275.167921:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789302275.168178:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121499776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6467us (6540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302275.168188:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789302275.168501:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121499776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302275.168513:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121500288:0@lo:400:kworker.0 00000100:00100000:2.0:1789302275.168553:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302275.168587:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121500800:0@lo:400:kworker.0 00000100:00100000:2.0:1789302275.168611:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302275.168638:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121500800 00000100:00100000:2.0:1789302275.168643:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121500800 00000100:00100000:1.0:1789302275.168771:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121500288 00000100:00100000:1.0:1789302275.168776:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121500288 00000100:00100000:1.0:1789302275.168811:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789302275.168819:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121500288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.168866:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121500288:12345-0@lo:400:kworker.0 Request processed in 48us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302275.168871:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789302275.168883:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302275.168910:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789302275.168913:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121501056 00000100:00100000:3.0:1789302275.168917:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121501056 00000100:00100000:1.0:1789302275.168921:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121500800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302275.168947:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789302275.168956:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121501056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.168967:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121500800:12345-0@lo:400:kworker.0 Request processed in 48us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302275.168986:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789302275.169061:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121500800:0@lo:400:kworker.0 00000100:00100000:2.0:1789302275.169069:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121501312:0@lo:400:kworker.0 00000100:00080000:0.0:1789302275.169100:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302275.169105:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302275.169107:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302275.177465:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121501056:12345-0@lo:400:kworker.0 Request processed in 8501us (8574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302275.177482:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789302275.177580:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121501056:0@lo:400:kworker.0 00000100:00100000:3.0:1789302275.177611:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121500032:0@lo:400:kworker.0 00000100:00100000:2.0:1789302275.180127:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302275.180209:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121500288:0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.180653:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121501312 00000100:00100000:1.0:1789302275.180660:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121501312 00000100:00100000:1.0:1789302275.180740:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789302275.180750:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121501312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302275.180815:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121501312:12345-0@lo:400:kworker.0 Request processed in 66us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302275.180822:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:2.0:1789302275.180910:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4adc8b100 x1876219121501312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302275.180922:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121501312:0@lo:400:kworker.0 00000100:00080000:3.0:1789302275.180995:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789302275.181529:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4adc8b800 x1876219121501440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302275.181542:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121501440:0@lo:400:kworker.0 00010000:00010000:3.0:1789302275.476320:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302275.672028:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302275.672051:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121501568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302275.672150:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302275.672216:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121501568 00000100:00100000:0.0:1789302275.672224:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121501568 00000100:00100000:0.0:1789302275.672267:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789302275.672288:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121501568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302275.672315:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302275.672372:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121501568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302275.672390:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:0.0:1789302275.672432:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f75180 x1876219121501568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302275.672450:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121501568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302275.678628:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121501696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302275.678703:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302275.678913:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121501696 00000100:00100000:0.0:1789302275.678921:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121501696 00000100:00100000:0.0:1789302275.678970:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789302275.678980:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121501696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302275.679002:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302275.679055:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121501696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302275.679061:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1789302275.679871:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4adc8a680 x1876219121501696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302275.679894:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121501696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302276.181840:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302276.181866:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121501824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789302276.181942:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302276.182053:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121501824 00000100:00100000:3.0:1789302276.182070:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121501824 00000100:00100000:3.0:1789302276.182307:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789302276.182321:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121501824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789302276.182373:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789302276.182654:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121501824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 336us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302276.182663:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789302276.182726:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121501824:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1789302276.299764:0:14080:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:24:34 (1789302274) 00000100:00100000:3.0:1789302276.446511:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302276.448156:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302276.448188:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302276.448212:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302276.448245:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302276.448361:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101479168 00000100:00100000:3.0:1789302276.448370:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101479168 00000100:00100000:3.0:1789302276.448503:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101479424 00000100:00100000:3.0:1789302276.448508:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101479424 00000100:00100000:3.0:1789302276.448529:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101479040 00000100:00100000:3.0:1789302276.448532:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101479040 00000100:00100000:3.0:1789302276.448547:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101479296 00000100:00100000:3.0:1789302276.448550:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101479296 00000100:00100000:3.0:1789302276.448569:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 291 00000100:00100000:3.0:1789302276.448580:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101479168:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302276.448653:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101479168:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 74us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302276.448660:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 291 00000100:00100000:3.0:1789302276.448676:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 292 00000100:00100000:1.0:1789302276.448736:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 293 00000100:00100000:1.0:1789302276.448751:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101479040:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302276.448783:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101479040:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 38us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302276.448789:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 293 00000100:00100000:1.0:1789302276.448803:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 294 00000100:00100000:1.0:1789302276.448809:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101479296:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302276.448831:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101479424:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302276.448832:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101479296:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302276.448844:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 294 00000100:00100000:3.0:1789302276.449048:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101479424:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 365us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302276.449056:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 292 00000100:00080000:3.0:1789302276.449081:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302276.449085:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789302276.451288:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101478912 00000100:00100000:0.0:1789302276.451302:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101478912 00000100:00100000:0.0:1789302276.451416:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 384 00000100:00100000:0.0:1789302276.451427:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101478912:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302276.451494:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101478912:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 69us (4990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302276.451501:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 384 00010000:00010000:1.0:1789302276.502293:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302277.524336:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302278.192826:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302278.193031:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101479552 00000100:00100000:1.0:1789302278.193040:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101479552 00000100:00100000:1.0:1789302278.193149:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 40 00000100:00100000:1.0:1789302278.193160:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:11089:x1876219101479552:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302278.193178:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302278.193213:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd3995cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a27 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302278.193288:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd3995d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302278.193302:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd3995d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302278.193314:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd3995d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302278.193358:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789302278.193362:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302278.193411:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd3995d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302278.193435:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd3995cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a27 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302278.193453:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd3995d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a27 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302278.193461:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962b00) 00010000:00010000:1.0:1789302278.193464:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302278.193467:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3600, rc 0) 00000100:00100000:1.0:1789302278.193699:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:11089:x1876219101479552:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 540us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302278.193707:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 40 00000100:00080000:3.0:1789302278.194991:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302278.208690:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302278.208854:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101479680 00000100:00100000:3.0:1789302278.208864:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101479680 00000100:00100000:3.0:1789302278.208931:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 41 00000100:00100000:3.0:1789302278.208951:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+6:11090:x1876219101479680:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302278.208972:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302278.209000:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd3995d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a2e expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209062:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd3995e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209076:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd3995e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209087:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd3995e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209102:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209109:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209146:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209212:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3995ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209219:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3995ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209227:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3995ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302278.209289:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789302278.209293:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302278.209315:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3995ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209778:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd3995e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209786:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd3995e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209792:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd3995e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209798:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302278.209802:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd3995e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209809:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd3995e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209821:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962b00) 00010000:00010000:3.0:1789302278.209824:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302278.209828:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd3995e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209835:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd3995e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209848:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209864:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209871:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209876:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302278.209879:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209886:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209894:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cc486113400) 00010000:00010000:3.0:1789302278.209897:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302278.209900:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209906:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209949:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd3995d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a2e expref: 8 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209962:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3995ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a2e expref: 7 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.209969:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cc486113200) 00010000:00010000:3.0:1789302278.209972:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302278.209980:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178200, rc 0) 00000100:00100000:3.0:1789302278.210222:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+7:11090:x1876219101479680:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1280us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302278.210231:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 41 00000100:00100000:2.0:1789302278.223599:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302278.228201:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101479808 00000100:00100000:0.0:1789302278.228216:0:6541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101479808 00000100:00100000:0.0:1789302278.228302:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:0.0:1789302278.228311:0:6541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c76ee310-c3b4-4286-aaea-77936c269d98+7:11090:x1876219101479808:12345-192.168.203.9@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789302278.229434:0:6541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c76ee310-c3b4-4286-aaea-77936c269d98+7:11090:x1876219101479808:12345-192.168.203.9@tcp:900:lhsmtool_posix.0 Request processed in 1119us (5839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302278.229444:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:2.0:1789302278.236558:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302278.236799:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101480064 00000100:00100000:3.0:1789302278.236810:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101480064 00000100:00100000:3.0:1789302278.236869:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 42 00000100:00100000:3.0:1789302278.236883:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:11090:x1876219101480064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302278.236902:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302278.236922:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd3995f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a35 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237002:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995fc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237019:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237031:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237064:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399603 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237072:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399603 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237079:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399603 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237220:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178400/0x1ff82925bd39960a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237240:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178400/0x1ff82925bd39960a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237247:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178400/0x1ff82925bd39960a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302278.237269:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789302278.237351:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237358:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995fc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237365:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237371:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302278.237376:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237383:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995fc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237394:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cc486113200) 00010000:00010000:3.0:1789302278.237397:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302278.237401:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237407:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3995fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237420:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399603 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237432:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399603 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237438:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399603 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237443:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302278.237445:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399603 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237451:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399603 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237458:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cc486113400) 00010000:00010000:3.0:1789302278.237460:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302278.237463:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399603 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.237468:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399603 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.239190:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd3995f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a35 expref: 10 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.239214:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178400/0x1ff82925bd39960a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a35 expref: 9 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302278.239222:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:3.0:1789302278.239225:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302278.239239:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178400, rc 0) 00000100:00100000:3.0:1789302278.239365:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+9:11090:x1876219101480064:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2486us (2815us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789302278.239373:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 42 00000100:00100000:2.0:1789302278.255814:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302278.255900:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101480192 00000100:00100000:1.0:1789302278.255916:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101480192 00000100:00100000:1.0:1789302278.255981:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 43 00000100:00100000:1.0:1789302278.255992:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+9:11090:x1876219101480192:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789302278.256091:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+9:11090:x1876219101480192:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 Request processed in 101us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302278.256098:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 43 00000100:00100000:2.0:1789302278.264088:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302278.264243:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101480320 00000100:00100000:3.0:1789302278.264262:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101480320 00000100:00100000:3.0:1789302278.264340:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 44 00000100:00100000:3.0:1789302278.264352:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:11090:x1876219101480320:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789302278.264513:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789302278.266374:0:10111:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1976us 00000100:00100000:3.0:1789302278.289790:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:11090:x1876219101480320:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 Request processed in 25433us (25704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302278.289805:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 44 00010000:00010000:3.0:1789302278.548418:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302278.740289:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302278.740311:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121501952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302278.740381:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302278.740442:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121501952 00000100:00100000:0.0:1789302278.740449:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121501952 00000100:00100000:0.0:1789302278.740504:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789302278.740514:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121501952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302278.740542:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302278.740584:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121501952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302278.740592:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1789302278.740612:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302278.740646:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121501952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302278.742469:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121502080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302278.742536:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302278.742585:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121502080 00000100:00100000:0.0:1789302278.742593:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121502080 00000100:00100000:0.0:1789302278.742663:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789302278.742673:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121502080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302278.742693:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302278.742749:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121502080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302278.742757:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1789302278.742851:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302278.742883:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121502080:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1789302278.997090:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789302279.064724:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789302279.572352:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302280.277275:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121502208:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277373:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277432:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121502720:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277463:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277486:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121503232:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277529:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277554:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121503744:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277578:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277606:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789302280.277612:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121502592:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277637:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277655:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121503104:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277674:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277689:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121503616:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277707:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277738:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121502464:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277762:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277811:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121502976:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277837:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277853:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121503488:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277871:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277891:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789302280.277897:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121502336:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277919:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277937:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121502848:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277956:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.277974:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121503360:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.277994:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302280.278024:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121502208 00000100:00100000:1.0:1789302280.278034:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121502208 00000100:00100000:1.0:1789302280.278102:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789302280.278132:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121502208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.278197:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121502208:12345-0@lo:400:kworker.0 Request processed in 86us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.278207:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789302280.278262:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121502720 00000100:00100000:1.0:1789302280.278267:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121502720 00000100:00100000:1.0:1789302280.278292:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121502464 00000100:00100000:1.0:1789302280.278295:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121502464 00000100:00100000:1.0:1789302280.278314:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789302280.278321:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121502720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.278360:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121502720:12345-0@lo:400:kworker.0 Request processed in 39us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.278377:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789302280.278391:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789302280.278397:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121502464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.278432:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121502464:12345-0@lo:400:kworker.0 Request processed in 36us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.278438:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789302280.278457:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121503232 00000100:00100000:1.0:1789302280.278460:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121503232 00000100:00100000:1.0:1789302280.278507:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121503744 00000100:00100000:1.0:1789302280.278511:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121503744 00000100:00100000:1.0:1789302280.278523:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121503104 00000100:00100000:1.0:1789302280.278526:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121503104 00000100:00100000:1.0:1789302280.278538:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121503616 00000100:00100000:1.0:1789302280.278540:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121503616 00000100:00100000:1.0:1789302280.278553:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789302280.278560:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121503232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.278592:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121503232:12345-0@lo:400:kworker.0 Request processed in 32us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.278599:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789302280.278611:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789302280.278617:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121503744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.278644:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121503744:12345-0@lo:400:kworker.0 Request processed in 27us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.278650:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789302280.278661:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789302280.278667:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121503104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.279083:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121503104:12345-0@lo:400:kworker.0 Request processed in 414us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.279090:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789302280.279104:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789302280.279131:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121503616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.279425:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121503616:12345-0@lo:400:kworker.0 Request processed in 314us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.279432:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789302280.279468:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121502592 00000100:00100000:1.0:1789302280.279474:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121502592 00000100:00100000:1.0:1789302280.279569:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121502976 00000100:00100000:1.0:1789302280.279573:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121502976 00000100:00100000:1.0:1789302280.279591:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121503488 00000100:00100000:1.0:1789302280.279594:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121503488 00000100:00100000:1.0:1789302280.279605:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121502336 00000100:00100000:1.0:1789302280.279608:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121502336 00000100:00100000:1.0:1789302280.279618:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121502848 00000100:00100000:1.0:1789302280.279620:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121502848 00000100:00100000:1.0:1789302280.279633:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121503360 00000100:00100000:1.0:1789302280.279635:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121503360 00000100:00100000:1.0:1789302280.279648:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789302280.279655:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121502592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.279689:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121502592:12345-0@lo:400:kworker.0 Request processed in 34us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.279695:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789302280.279707:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789302280.279712:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121502976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.279739:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121502976:12345-0@lo:400:kworker.0 Request processed in 26us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.279756:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789302280.279769:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789302280.279775:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121503488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.279803:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876219121503488:12345-0@lo:400:kworker.0 Request processed in 28us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.279809:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789302280.279821:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789302280.279826:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121502336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.279853:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121502336:12345-0@lo:400:kworker.0 Request processed in 27us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.279859:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789302280.279869:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789302280.279875:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121502848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.279899:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121502848:12345-0@lo:400:kworker.0 Request processed in 25us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.279905:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789302280.279918:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789302280.280263:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121503360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.280298:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121503360:12345-0@lo:400:kworker.0 Request processed in 40us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.280304:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:1.0:1789302280.280473:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302280.280478:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789302280.280482:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302280.280485:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302280.284396:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121502336:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.284418:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121502848:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.284432:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121503360:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.284447:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121502464:0@lo:400:kworker.0 00010000:00080000:1.0:1789302280.284464:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc484fe0000 x1876219121502976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302280.284477:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121502976:0@lo:400:kworker.0 00010000:00080000:1.0:1789302280.284490:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc484fe2300 x1876219121503488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302280.284499:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121503488:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.284559:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121502592:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.284574:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121503104:0@lo:400:kworker.0 00010000:00080000:1.0:1789302280.284587:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc484fe3800 x1876219121503616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302280.284597:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121503616:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.284609:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121502208:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.284622:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121502720:0@lo:400:kworker.0 00000100:00100000:1.0:1789302280.284634:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121503232:0@lo:400:kworker.0 00010000:00080000:1.0:1789302280.284647:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc484fe1f80 x1876219121503744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302280.284669:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121503744:0@lo:400:kworker.0 00000100:00100000:2.0:1789302280.286946:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302280.286985:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121503872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302280.287082:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302280.287481:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121503872 00000100:00100000:3.0:1789302280.287504:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121503872 00000100:00100000:3.0:1789302280.287568:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789302280.287579:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121503872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789302280.287625:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302280.287688:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121503872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302280.287697:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789302280.287890:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121503872:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789302280.599849:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302280.714091:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302280.714378:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101480448 00000100:00100000:1.0:1789302280.714388:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101480448 00000100:00100000:1.0:1789302280.714451:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 45 00000100:00100000:1.0:1789302280.714461:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+9:11132:x1876219101480448:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302280.714480:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302280.714500:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a3c expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714636:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39961f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714651:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39961f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714663:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39961f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714677:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399626 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714684:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714690:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714732:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39961f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714745:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39961f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714752:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39961f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714759:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302280.714763:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39961f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714770:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39961f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714781:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962b00) 00010000:00010000:1.0:1789302280.714784:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302280.714788:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39961f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714794:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39961f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714807:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714813:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399626 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714819:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714824:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302280.714833:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714839:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399626 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714848:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cc383963000) 00010000:00010000:1.0:1789302280.714850:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302280.714854:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399626 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714860:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399626 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714892:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399618 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a3c expref: 10 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.714903:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962b00) 00010000:00010000:1.0:1789302280.714905:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302280.714909:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a3c expref: 10 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.716020:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3e00, rc 0) 00000100:00100000:1.0:1789302280.716089:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+9:11132:x1876219101480448:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1627us (2004us total) trans 0 rc 301/301 00000100:00100000:1.0:1789302280.716098:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 45 00000100:00080000:1.0:1789302280.716996:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302280.726077:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302280.726162:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101480704 00000100:00100000:0.0:1789302280.726171:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101480704 00000100:00100000:0.0:1789302280.726215:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 46 00000100:00100000:0.0:1789302280.726224:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+9:11132:x1876219101480704:12345-192.168.203.9@tcp:36:lfs.0 00010000:00010000:0.0:1789302280.726286:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302280.727407:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd3995d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a27 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.727427:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383962b00) 00010000:00010000:0.0:1789302280.727438:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302280.727501:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39962d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.727514:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39962d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.727525:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39962d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.727538:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.727545:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.727551:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731010:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731036:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731049:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789302280.731076:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000076861de reply state 000000008899939e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731088:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731095:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:0.0:1789302280.731098:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789302280.731103:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789302280.731109:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789302280.731138:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39962d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731145:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39962d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731152:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39962d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731158:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302280.731162:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39962d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731183:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39962d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731194:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302280.731196:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302280.731200:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39962d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731206:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39962d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789302280.731222:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000076861de reply state 000000008899939e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731230:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302280.731246:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cc488eace00) 00010000:00010000:0.0:1789302280.731249:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789302280.731251:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789302280.733095:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+10:11132:x1876219101480704:12345-192.168.203.9@tcp:36:lfs.0 Request processed in 6862us (7018us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789302280.733108:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 46 00000100:00100000:2.0:1789302280.788299:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121504000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302280.788370:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302280.788490:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121504000 00000100:00100000:3.0:1789302280.788499:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121504000 00000100:00100000:3.0:1789302280.788553:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789302280.788563:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121504000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789302280.788591:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302280.788641:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38425c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121504128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302280.788678:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302280.789749:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121504128 00000100:00100000:0.0:1789302280.789758:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121504128 00000100:00100000:0.0:1789302280.789796:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789302280.789806:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121504128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302280.789824:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302280.789892:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121504128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302280.789910:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:2.0:1789302280.790410:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc38425c000 x1876219121504128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302280.790432:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38425c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121504128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302280.792137:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121504000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3566us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302280.792151:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:1.0:1789302280.797976:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383be4a80 x1876219121504000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302280.798006:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121504000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302280.842390:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302280.842550:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101480832 00000100:00100000:3.0:1789302280.842560:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101480832 00000100:00100000:3.0:1789302280.842614:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 47 00000100:00100000:3.0:1789302280.842623:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+10:11140:x1876219101480832:12345-192.168.203.9@tcp:101:lctl.0 00010000:00010000:3.0:1789302280.842647:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302280.842668:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a43 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302280.842723:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399649 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302280.842736:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302280.842746:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302280.842789:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789302280.842792:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302280.842824:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302280.842877:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a43 expref: 12 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302280.842896:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a43 expref: 11 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302280.842904:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa9500) 00010000:00010000:3.0:1789302280.842907:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302280.842911:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178600, rc 0) 00000100:00100000:3.0:1789302280.842970:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+11:11140:x1876219101480832:12345-192.168.203.9@tcp:101:lctl.0 Request processed in 347us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302280.842977:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 47 00000100:00100000:0.0:1789302280.933426:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302280.933787:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101480960 00000100:00100000:1.0:1789302280.933802:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101480960 00000100:00100000:1.0:1789302280.933891:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 48 00000100:00100000:1.0:1789302280.933904:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+11:11146:x1876219101480960:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1789302280.933938:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302280.933967:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a4a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.934047:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399657 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.934064:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.934078:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.934090:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39965e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.934097:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39965e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.934103:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39965e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.934288:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399665 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.934298:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399665 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.934306:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399665 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302280.934351:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789302280.934355:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302280.934879:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399665 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.934898:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.934905:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399657 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935586:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399657 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935598:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302280.935603:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399657 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935614:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399657 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935632:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa9500) 00010000:00010000:1.0:1789302280.935650:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302280.935658:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399657 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935665:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399657 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935686:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39965e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935692:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39965e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935699:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39965e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935705:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302280.935708:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39965e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935714:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39965e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935723:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cc488eace00) 00010000:00010000:1.0:1789302280.935726:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302280.935729:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39965e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935734:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39965e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935777:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a4a expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935807:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399665 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a4a expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.935814:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302280.935817:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789302280.935820:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3c00, rc 0) 00000100:00100000:1.0:1789302280.938707:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+12:11146:x1876219101480960:12345-192.168.203.9@tcp:101:bash.0 Request processed in 2017us (2507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.938725:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 48 00000100:00100000:0.0:1789302280.948410:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302280.948770:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101481216 00000100:00100000:1.0:1789302280.948786:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101481216 00000100:00100000:1.0:1789302280.948864:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 49 00000100:00100000:1.0:1789302280.948876:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+12:11146:x1876219101481216:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1789302280.948904:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302280.948931:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39966c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a51 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.949071:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399673 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.949091:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399673 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.949105:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399673 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.953757:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.953794:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.953807:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789302280.955099:0:6532:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789302280.955287:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399681 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.955301:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399681 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.955313:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399681 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.955345:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399673 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.956793:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399673 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.956804:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399673 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.956811:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302280.956817:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399673 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.956827:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399673 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.956864:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302280.956867:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302280.956873:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399673 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.956880:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399673 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302280.956900:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a7c2024 reply state 0000000014647dd4 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.956914:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.956920:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383963000) 00010000:00010000:1.0:1789302280.956922:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789302280.956925:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789302280.956976:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd39966c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a51 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.956993:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399681 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a51 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.957001:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc383963e00) 00010000:00010000:1.0:1789302280.957003:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302280.957006:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3600, rc 0) 00000100:00100000:1.0:1789302280.957068:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+15:11146:x1876219101481216:12345-192.168.203.9@tcp:101:bash.0 Request processed in 8194us (8683us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789302280.957077:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 49 00000100:00100000:2.0:1789302280.960571:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302280.962666:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101481344 00000100:00100000:1.0:1789302280.962681:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101481344 00000100:00100000:1.0:1789302280.962731:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 28 00000100:00100000:1.0:1789302280.962740:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1876219101481344:12345-192.168.203.9@tcp:8:bash.0 00010000:00080000:1.0:1789302280.962794:0:8446:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp t0 exp 0000000000000000 cur 357 last 0 00000020:00000080:1.0:1789302280.962824:0:8446:0:(genops.c:1384:class_connect()) connect: client c76ee310-c3b4-4286-aaea-77936c269d98, cookie 0x1ff82925bd39968f 00002000:00100000:1.0:1789302280.962850:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c76ee310-c3b4-4286-aaea-77936c269d98/ffff8cc486747800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789302280.962862:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789302280.962938:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789302280.962971:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8cc38401d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302280.963048:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2395:x1876219101481344:12345-192.168.203.9@tcp:8:bash.0 Request processed in 307us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.963056:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 28 00000100:00100000:0.0:1789302280.973270:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302280.973767:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101481472 00000100:00100000:1.0:1789302280.973776:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101481472 00000100:00100000:1.0:1789302280.973874:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00100000:1.0:1789302280.973885:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:0:x1876219101481472:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1789302280.973903:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302280.973928:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7ed35f6/0x1ff82925bd399696 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a58 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789302280.973952:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302280.973972:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1789302280.973976:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302280.973985:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed35f6/0x1ff82925bd399696 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a58 expref: 7 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.974025:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed35f6/0x1ff82925bd399696 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a58 expref: 7 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.974039:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3e00, rc 0) 00000100:00100000:1.0:1789302280.974101:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+7:0:x1876219101481472:12345-192.168.203.9@tcp:101:bash.0 Request processed in 218us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302280.974108:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00080000:2.0:1789302280.978605:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302280.988830:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302280.989292:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101481600 00000100:00100000:1.0:1789302280.989317:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101481600 00000100:00100000:1.0:1789302280.989537:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:1.0:1789302280.989549:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+7:11146:x1876219101481600:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1789302280.989568:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302280.989587:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a5f expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.989618:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed35f6/0x1ff82925bd399696 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a58 expref: 8 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.989628:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302280.989632:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302280.989637:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.989672:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7ed35f6/0x1ff82925bd399696 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a58 expref: 8 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302280.989703:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7ed35f6/0x1ff82925bd399696 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a58 expref: 8 pid: 8445 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302280.989717:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38425c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8446:1876219121504256:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302280.989823:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789302281.009198:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302281.009289:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101481728 00000100:00100000:3.0:1789302281.009300:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101481728 00010000:00010000:3.0:1789302281.009340:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ed35f6/0x1ff82925bd399696 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a58 expref: 9 pid: 8445 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302281.009389:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:3.0:1789302281.009399:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+9:2399:x1876219101481728:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302281.009413:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302281.009436:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7ed35f6/0x1ff82925bd399696 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a58 expref: 9 pid: 8445 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.009450:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7ed35f6/0x1ff82925bd399696 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a58 expref: 9 pid: 8445 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.009490:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302281.009495:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302281.009503:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.009514:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.009551:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302281.009566:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6517:1876219121504384:192.168.203.9@tcp:105: 00000100:00100000:3.0:1789302281.009638:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfddd80 going to sleep for 11 seconds 00010000:00010000:2.0:1789302281.010084:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7ed35f6/0x1ff82925bd399696 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a58 expref: 9 pid: 8445 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302281.010102:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38425c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8446:1876219121504256:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302281.010163:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.010174:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2400, rc 0) 00000100:00100000:2.0:1789302281.010210:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+8:11146:x1876219101481600:12345-192.168.203.9@tcp:101:bash.0 Request processed in 20663us (21395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302281.010218:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:3.0:1789302281.013931:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6517:1876219121504384:192.168.203.9@tcp:105: 00010000:00010000:3.0:1789302281.013968:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302281.014047:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101481728:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 4647us (4856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302281.014062:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:2.0:1789302281.024702:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.024805:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101481984 00000100:00100000:1.0:1789302281.024815:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101481984 00000100:00100000:1.0:1789302281.024876:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6 00000100:00100000:1.0:1789302281.024886:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+15:11146:x1876219101481984:12345-192.168.203.9@tcp:35:bash.0 00000001:00080000:1.0:1789302281.025089:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000100:00100000:1.0:1789302281.025256:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+17:11146:x1876219101481984:12345-192.168.203.9@tcp:35:bash.0 Request processed in 370us (563us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789302281.025263:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6 00000020:00080000:1.0:1789302281.025268:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1789302281.045378:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789302281.109391:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789302281.162071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.162348:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101482240 00000100:00100000:1.0:1789302281.162361:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101482240 00000100:00100000:1.0:1789302281.162447:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 50 00000100:00100000:1.0:1789302281.162460:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+17:11156:x1876219101482240:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302281.162494:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302281.162522:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3996a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a66 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302281.163159:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789302281.163318:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3996a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a66 expref: 19 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.163353:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa9500) 00010000:00010000:1.0:1789302281.163357:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302281.163364:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3996a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a66 expref: 19 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.163381:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2c00, rc 0) 00000100:00100000:1.0:1789302281.163467:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+18:11156:x1876219101482240:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1010us (1410us total) trans 4294967316 rc 301/301 00000100:00100000:1.0:1789302281.163476:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 50 00000100:00100000:2.0:1789302281.169867:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.176018:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101482496 00000100:00100000:1.0:1789302281.176040:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101482496 00000100:00100000:1.0:1789302281.176150:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:1.0:1789302281.176165:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+18:11156:x1876219101482496:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:1.0:1789302281.176709:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+19:11156:x1876219101482496:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 479us (6788us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789302281.176721:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:3.0:1789302281.276702:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.277054:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101482624 00000100:00100000:1.0:1789302281.277069:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101482624 00000100:00100000:1.0:1789302281.277398:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 51 00000100:00100000:1.0:1789302281.277414:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+19:11162:x1876219101482624:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302281.277448:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302281.277477:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3996b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a6d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.277587:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd3996b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.277625:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd3996b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.277643:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd3996b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302281.277706:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789302281.277711:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302281.277739:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd3996b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.277775:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3996b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a6d expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.277800:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd3996b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a6d expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.277810:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302281.277813:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302281.277818:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3a00, rc 0) 00000100:00100000:1.0:1789302281.277963:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+20:11162:x1876219101482624:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 553us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302281.289822:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 51 00000100:00100000:3.0:1789302281.292709:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.293203:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101482880 00000100:00100000:1.0:1789302281.293216:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101482880 00000100:00100000:1.0:1789302281.293311:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:1.0:1789302281.293324:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+20:11162:x1876219101482880:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302281.293353:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302281.293396:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a74 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.293537:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd3996c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.293555:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd3996c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.293570:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd3996c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302281.293585:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789302281.293727:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a74 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.293749:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd3996c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a74 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.293758:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc383963e00) 00010000:00010000:1.0:1789302281.293761:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302281.293766:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2200, rc 0) 00000100:00100000:1.0:1789302281.293852:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+22:11162:x1876219101482880:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 530us (1169us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789302281.293861:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:2.0:1789302281.302809:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302281.302883:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.302966:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101483136 00000100:00100000:1.0:1789302281.302980:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101483136 00000100:00100000:1.0:1789302281.303055:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 53 00000100:00100000:1.0:1789302281.303067:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+22:11162:x1876219101483136:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302281.303108:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302281.303156:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a7b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.303422:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3996dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.303441:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3996dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.303456:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3996dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302281.303472:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789302281.303611:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a7b expref: 25 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.303633:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3996dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a7b expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.303641:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc383963e00) 00010000:00010000:1.0:1789302281.303644:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789302281.303648:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2c00, rc 0) 00000100:00100000:1.0:1789302281.303724:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+24:11162:x1876219101483136:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 659us (928us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789302281.303731:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 53 00000100:00100000:0.0:1789302281.303930:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302281.303951:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121504512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789302281.304009:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302281.304156:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101483264 00000100:00100000:3.0:1789302281.304165:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101483264 00000100:00100000:3.0:1789302281.304242:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:3.0:1789302281.304253:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+24:2396:x1876219101483264:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302281.304280:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302281.304298:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd3996c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a74 expref: 24 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.304311:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc383963e00) 00010000:00010000:3.0:1789302281.304315:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302281.304340:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+23:2396:x1876219101483264:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 90us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302281.304348:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:1.0:1789302281.305142:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121504512 00000100:00100000:1.0:1789302281.305151:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121504512 00000100:00100000:1.0:1789302281.305197:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789302281.305239:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121504512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789302281.305277:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1789302281.305341:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121504512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302281.305349:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789302281.307068:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121504512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302281.322082:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.322440:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101483392 00000100:00100000:1.0:1789302281.322455:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101483392 00000100:00100000:1.0:1789302281.322534:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:1.0:1789302281.322546:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101483392:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:1.0:1789302281.322612:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.322642:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.322652:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302281.322658:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302281.322663:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.322708:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 7 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.322725:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 7 pid: 8446 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302281.322743:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38425c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1876219121504640:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302281.322899:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789302281.327059:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302281.327255:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101483520 00000100:00100000:2.0:1789302281.327266:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101483520 00002000:00100000:2.0:1789302281.327314:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8cc4b7eef800 x1876219101483520/t0(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:612/0 lens 504/0 e 0 to 0 dl 1789302292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302281.327326:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4b7eef800 with x1876219101483520 ext(0->12) 00010000:00010000:2.0:1789302281.327335:0:8450:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 8 pid: 8446 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.327353:0:8450:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 8 pid: 8446 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302281.327360:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cc4b7eef800 00000100:00100000:2.0:1789302281.327399:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 0 00000100:00100000:2.0:1789302281.327410:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c76ee310-c3b4-4286-aaea-77936c269d98+8:2399:x1876219101483520:12345-192.168.203.9@tcp:4:lfs.0 00000100:00100000:1.0:1789302281.329403:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38425c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8445:1876219121504640:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302281.329445:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1789302281.332495:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000100:00100000:2.0:1789302281.336748:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c76ee310-c3b4-4286-aaea-77936c269d98+9:2399:x1876219101483520:12345-192.168.203.9@tcp:4:lfs.0 Request processed in 9320us (9680us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789302281.336762:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 0 00002000:00100000:2.0:1789302281.336776:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8cc4b7eef800 x1876219101483520/t4294967300(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:612/0 lens 504/448 e 0 to 0 dl 1789302292 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302281.336786:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4b7eef800 with x1876219101483520 ext(0->12) 00010000:00010000:2.0:1789302281.336799:0:8450:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 9 pid: 8446 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.336820:0:8450:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 9 pid: 8446 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302281.336853:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cc4b7eef800 00000100:00100000:3.0:1789302281.355627:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302281.355762:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101483648 00000100:00100000:2.0:1789302281.355772:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101483648 00010000:00010000:2.0:1789302281.355814:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 9 pid: 8446 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302281.355870:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 53 00000100:00100000:2.0:1789302281.355880:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+9:2398:x1876219101483648:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302281.355896:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789302281.355927:0:6515:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789302281.355930:0:6515:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789302281 00002000:00010000:2.0:1789302281.355933:0:6515:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789302281 00002000:00010000:2.0:1789302281.355936:0:6515:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789302281 00002000:00010000:2.0:1789302281.355938:0:6515:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789302281.355946:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 9 pid: 8446 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.355970:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 9 pid: 8446 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.356296:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000283818c9/0x1ff82925bd39969d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a5f expref: 9 pid: 8446 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.356316:0:6515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302281.356320:0:6515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302281.356338:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.356349:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.356376:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302281.356435:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101483648:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 556us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302281.356444:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 53 00010000:00010000:1.0:1789302281.356529:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.356540:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.356561:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.356570:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.356580:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.356588:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302281.356592:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.356602:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.356627:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.356635:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000120e146e/0x1ff82925bd3996ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302281.356685:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101483392:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 34142us (34616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302281.356694:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:0.0:1789302281.365667:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.365837:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101483904 00000100:00100000:1.0:1789302281.365846:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101483904 00000100:00100000:1.0:1789302281.365903:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 8 00000100:00100000:1.0:1789302281.365914:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+23:11162:x1876219101483904:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:1.0:1789302281.365984:0:6534:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3996dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a7b expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789302281.366421:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789302281.366462:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:1.0:1789302281.366896:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:1.0:1789302281.366936:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.367018:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399681 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a51 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.367029:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.367072:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399681 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a51 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.367087:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399681 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a51 expref: 27 pid: 6532 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302281.367101:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38425c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6534:1876219121504768:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302281.367320:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302281.372396:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38425c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6534:1876219121504768:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302281.372433:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302281.376633:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302281.376735:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101484032 00000100:00100000:3.0:1789302281.376745:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101484032 00010000:00010000:3.0:1789302281.376782:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399681 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a51 expref: 28 pid: 6532 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302281.376822:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 54 00000100:00100000:3.0:1789302281.376832:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+28:2399:x1876219101484032:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302281.376845:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302281.376851:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399681 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a51 expref: 28 pid: 6532 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.376864:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399681 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a51 expref: 28 pid: 6532 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.376898:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399681 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a51 expref: 28 pid: 6532 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.377402:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc383963e00) 00010000:00010000:3.0:1789302281.377409:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.377420:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.377428:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.377501:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302281.377561:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+27:2399:x1876219101484032:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 730us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302281.377569:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 54 00010000:00010000:1.0:1789302281.377620:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.377628:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789302281.377733:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000001:00080000:1.0:1789302281.377841:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1789302281.377940:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38425c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6534:1876219121504896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789302281.378756:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302281.378858:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7840 going to sleep for 11 seconds 00000100:00100000:3.0:1789302281.378900:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121504896 00000100:00100000:3.0:1789302281.378907:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121504896 00000100:00100000:3.0:1789302281.379049:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789302281.379059:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6534:x1876219121504896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789302281.379250:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6534:x1876219121504896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 192us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302281.379257:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789302281.379340:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38425c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6534:1876219121504896:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789302281.379504:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:2.0:1789302281.379567:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6534:1876219121505024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789302281.379598:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302281.379766:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4c206d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789302281.379967:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121505024 00000100:00100000:3.0:1789302281.379973:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121505024 00000100:00100000:3.0:1789302281.380208:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789302281.380218:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6534:x1876219121505024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789302281.380394:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6534:x1876219121505024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 178us (794us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789302281.380401:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789302281.380481:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6534:1876219121505024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789302281.380525:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1789302281.380559:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.380568:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.380575:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.380580:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302281.380584:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.380599:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.380613:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc383963e00) 00010000:00010000:2.0:1789302281.380616:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789302281.380621:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.380628:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3996f1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302281.380789:0:6534:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789302281.380839:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789302281.380848:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357423734685ns, next at 358423733031ns, rc = 0 00000001:00080000:2.0:1789302281.380853:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00010000:00010000:2.0:1789302281.380874:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc383963e00) 00010000:00010000:2.0:1789302281.380876:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789302281.380882:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3996dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a7b expref: 31 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302281.381029:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+30:11162:x1876219101483904:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 15116us (15370us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789302281.381037:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 8 00000020:00080000:2.0:1789302281.381041:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789302281.388852:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.389632:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101484160 00000100:00100000:1.0:1789302281.389648:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101484160 00000100:00100000:0.0:1789302281.390350:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 54 00000100:00100000:0.0:1789302281.390366:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+30:11162:x1876219101484160:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1789302281.390590:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302281.390625:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd3996f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a82 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302281.390710:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd3996f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a82 expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302281.390730:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd3996f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a82 expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302281.390830:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302281.390833:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302281.390855:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538f200, rc 0) 00000100:00100000:0.0:1789302281.391494:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+31:11162:x1876219101484160:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1128us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302281.391576:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 54 00000100:00100000:0.0:1789302281.400067:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302281.400166:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101484416 00000100:00100000:2.0:1789302281.400182:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101484416 00000100:00100000:2.0:1789302281.400284:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 9 00000100:00100000:2.0:1789302281.400297:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+31:11162:x1876219101484416:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:2.0:1789302281.400554:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+32:11162:x1876219101484416:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 259us (500us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789302281.400562:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 9 00000100:00100000:3.0:1789302281.509685:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302281.509961:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101484672 00000100:00100000:2.0:1789302281.509974:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101484672 00000100:00100000:2.0:1789302281.510058:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 55 00000100:00100000:2.0:1789302281.510071:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+32:11172:x1876219101484672:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302281.510103:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302281.510283:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3996ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a89 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302281.510421:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789302281.510683:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3996ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a89 expref: 34 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.510701:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa9500) 00010000:00010000:2.0:1789302281.510704:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302281.510711:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3996ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a89 expref: 34 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.510728:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348800, rc 0) 00000100:00100000:2.0:1789302281.510962:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+33:11172:x1876219101484672:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 892us (1290us total) trans 4294967330 rc 301/301 00000100:00100000:2.0:1789302281.510971:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 55 00000100:00100000:0.0:1789302281.524846:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302281.525037:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101484800 00000100:00100000:2.0:1789302281.525052:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101484800 00000100:00100000:1.0:1789302281.525263:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 56 00000100:00100000:1.0:1789302281.525278:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+33:11172:x1876219101484800:12345-192.168.203.9@tcp:34:lfs.0 00010000:00010000:1.0:1789302281.525424:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39970d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525447:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39970d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525462:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39970d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525477:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399714 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525484:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525491:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525597:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd39971b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525606:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd39971b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525614:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd39971b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302281.525678:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd39971b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525695:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39970d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525713:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39970d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525720:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39970d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525727:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302281.525732:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39970d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525740:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39970d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525755:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302281.525758:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302281.525764:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39970d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525771:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39970d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525787:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525793:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399714 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525799:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399714 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525804:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302281.525813:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399714 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525820:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399714 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525827:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383963000) 00010000:00010000:1.0:1789302281.525831:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302281.525834:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399714 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525840:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399714 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525851:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd39971b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525857:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd39971b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525863:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd39971b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525868:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302281.525871:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd39971b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525877:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd39971b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525883:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:1.0:1789302281.525885:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302281.525894:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd39971b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.525899:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd39971b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302281.528450:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+33:11172:x1876219101484800:12345-192.168.203.9@tcp:34:lfs.0 Request processed in 3151us (3597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302281.528474:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 56 00000100:00100000:2.0:1789302281.534008:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.534194:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101485056 00000100:00100000:1.0:1789302281.534207:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101485056 00000100:00100000:1.0:1789302281.534288:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 10 00000100:00100000:1.0:1789302281.534300:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+33:11172:x1876219101485056:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:1.0:1789302281.534624:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+34:11172:x1876219101485056:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 324us (629us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789302281.534632:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 10 00000100:00100000:0.0:1789302281.567559:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302281.567617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302281.567650:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302281.567689:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302281.567733:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101485440 00000100:00100000:0.0:1789302281.567747:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101485440 00000100:00100000:0.0:1789302281.567819:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101485312 00000100:00100000:0.0:1789302281.567822:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101485312 00000100:00100000:0.0:1789302281.567845:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101485568 00000100:00100000:0.0:1789302281.567848:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101485568 00000100:00100000:0.0:1789302281.567867:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 301 00000100:00100000:0.0:1789302281.567879:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101485440:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302281.568105:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101485440:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 227us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302281.568288:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 301 00000100:00100000:0.0:1789302281.568314:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 302 00000100:00100000:0.0:1789302281.568322:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101485312:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302281.568352:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101485312:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 32us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302281.568359:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 302 00000100:00100000:0.0:1789302281.568381:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 303 00000100:00100000:0.0:1789302281.568407:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101485568:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302281.568436:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101485568:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 29us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302281.568443:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 303 00000100:00080000:2.0:1789302281.570156:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302281.570169:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302281.570763:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101485184 00000100:00100000:3.0:1789302281.570778:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101485184 00000100:00100000:3.0:1789302281.570850:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 386 00000100:00100000:3.0:1789302281.570862:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101485184:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302281.570972:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101485184:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 111us (3430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302281.570981:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 386 00000100:00100000:0.0:1789302281.598277:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302281.598698:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101485824 00000100:00100000:2.0:1789302281.598714:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101485824 00000100:00100000:2.0:1789302281.598857:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 57 00000100:00100000:2.0:1789302281.598870:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+34:11175:x1876219101485824:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302281.598902:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302281.598941:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399722 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a90 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.599050:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399729 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.599071:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399729 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.599086:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399729 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.599098:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399730 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.599105:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.599306:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.599774:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399737 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.599786:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399737 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.599813:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399737 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302281.599826:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789302281.600047:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399729 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600056:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399729 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600063:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399729 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600069:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302281.600074:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399729 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600082:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399729 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600095:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:2.0:1789302281.600099:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302281.600104:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399729 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600110:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399729 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600238:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600245:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399730 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600258:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600264:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302281.600267:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600273:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399730 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600283:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383963000) 00010000:00010000:2.0:1789302281.600286:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302281.600289:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399730 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600295:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399730 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600356:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399722 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a90 expref: 37 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600373:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399737 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a90 expref: 36 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302281.600381:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302281.600765:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302281.600770:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349c00, rc 0) 00000100:00100000:2.0:1789302281.600979:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+36:11175:x1876219101485824:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 2109us (2719us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789302281.601002:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 57 00000100:00100000:3.0:1789302281.605149:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.605252:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101485952 00000100:00100000:1.0:1789302281.605268:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101485952 00000100:00100000:1.0:1789302281.605346:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 58 00000100:00100000:1.0:1789302281.605359:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+36:11175:x1876219101485952:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:1.0:1789302281.605460:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399745 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.605481:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.605506:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.605552:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.605578:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399745 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.605586:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399745 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.605593:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302281.605599:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399745 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.605607:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399745 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.605621:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:1.0:1789302281.605624:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302281.605631:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399745 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302281.605636:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399745 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302281.606337:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+36:11175:x1876219101485952:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 975us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302281.606349:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 58 00000100:00100000:3.0:1789302281.608640:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.608796:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101486208 00000100:00100000:1.0:1789302281.608810:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101486208 00000100:00100000:1.0:1789302281.608876:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 11 00000100:00100000:1.0:1789302281.608888:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+36:11175:x1876219101486208:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:1.0:1789302281.609220:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+37:11175:x1876219101486208:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 334us (592us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789302281.609256:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 11 00010000:00010000:3.0:1789302281.631092:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302281.987942:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302281.989248:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101486464 00000100:00100000:0.0:1789302281.989443:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101486464 00000100:00100000:0.0:1789302281.989551:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 59 00000100:00100000:0.0:1789302281.989564:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+37:11206:x1876219101486464:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:0.0:1789302281.989599:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302281.989630:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39974c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a97 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302281.989808:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399753 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302281.989825:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399753 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302281.989841:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399753 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302281.989855:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789302281.990028:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f400/0x1ff82925bd39974c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a97 expref: 40 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302281.990049:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399753 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a97 expref: 39 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302281.991355:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302281.991364:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302281.991370:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311ca00, rc 0) 00000100:00100000:0.0:1789302281.991633:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+39:11206:x1876219101486464:12345-192.168.203.9@tcp:101:cat.0 Request processed in 2068us (3701us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789302281.991643:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 59 00000100:00100000:0.0:1789302281.998414:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.998479:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101486848 00000100:00100000:1.0:1789302281.998493:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101486848 00000100:00100000:1.0:1789302281.998569:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:1.0:1789302281.998582:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+39:11206:x1876219101486848:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:0.0:1789302281.998655:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302281.998933:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+40:11206:x1876219101486848:12345-192.168.203.9@tcp:35:cat.0 Request processed in 321us (502us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789302281.998943:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:3.0:1789302281.999424:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101486592 00000100:00100000:3.0:1789302281.999431:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101486592 00000100:00100000:3.0:1789302281.999615:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4 00000100:00100000:3.0:1789302281.999626:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7face00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+40:2398:x1876219101486592:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302281.999639:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302281.999668:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399753 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a97 expref: 40 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302281.999687:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:3.0:1789302281.999692:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302281.999723:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7face00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+39:2398:x1876219101486592:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 101us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302281.999750:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4 00000100:00100000:3.0:1789302282.089577:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302282.090012:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101487104 00000100:00100000:2.0:1789302282.090027:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101487104 00000100:00100000:2.0:1789302282.090174:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:2.0:1789302282.090193:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+39:11212:x1876219101487104:12345-192.168.203.9@tcp:101:dd.0 00010000:00010000:2.0:1789302282.090238:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302282.090242:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789302282.090276:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd3996b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a6d expref: 39 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.090298:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:2.0:1789302282.090304:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302282.090321:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399761 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5a9e expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789302282.090569:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789302282.090645:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.090663:0:9541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399737 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a90 expref: 39 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.090673:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.090714:0:9541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399737 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a90 expref: 39 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.090754:0:9541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399737 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a90 expref: 39 pid: 9541 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302282.090770:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121505152:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302282.090946:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49a5a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302282.096820:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302282.099051:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101487232 00000100:00100000:3.0:1789302282.099077:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101487232 00010000:00010000:3.0:1789302282.099215:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399737 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a90 expref: 40 pid: 9541 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302282.099284:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 55 00000100:00100000:3.0:1789302282.099296:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+40:2398:x1876219101487232:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302282.099318:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302282.099326:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399737 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a90 expref: 40 pid: 9541 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302282.099341:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399737 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a90 expref: 40 pid: 9541 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302282.099369:0:13201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:3.0:1789302282.099375:0:13201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302282.099401:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302282.099409:0:13201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302282.099863:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302282.099960:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+40:2398:x1876219101487232:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 664us (3154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302282.099990:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 55 00010000:00010000:2.0:1789302282.101848:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399737 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a90 expref: 39 pid: 9541 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302282.101881:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121505152:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302282.101920:0:9541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.101931:0:9541:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.101937:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302282.101966:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789302282.102297:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399761 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a9e expref: 40 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.102315:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a9e expref: 39 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.102325:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302282.102344:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789302282.102349:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348600, rc 0) 00000100:00100000:2.0:1789302282.102884:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+39:11212:x1876219101487104:12345-192.168.203.9@tcp:101:dd.0 Request processed in 12695us (13317us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789302282.102895:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:3.0:1789302282.112354:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302282.112460:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101487360 00000100:00100000:1.0:1789302282.112474:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101487360 00000100:00100000:1.0:1789302282.112556:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:1.0:1789302282.112569:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+39:11212:x1876219101487360:12345-192.168.203.9@tcp:101:dd.0 00010000:00010000:1.0:1789302282.112601:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302282.112629:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399776 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5aa5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302282.112675:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39977d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302282.112694:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39977d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302282.112709:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39977d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302282.112854:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399776 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aa5 expref: 41 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302282.112890:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39977d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aa5 expref: 40 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302282.112900:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:1.0:1789302282.112904:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302282.112909:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2400, rc 0) 00000100:00100000:1.0:1789302282.112995:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+40:11212:x1876219101487360:12345-192.168.203.9@tcp:101:dd.0 Request processed in 428us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302282.113004:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:1.0:1789302282.120015:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302282.121874:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101487616 00000100:00100000:0.0:1789302282.121894:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101487616 00000100:00100000:0.0:1789302282.122000:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 62 00000100:00100000:0.0:1789302282.122012:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+40:11212:x1876219101487616:12345-192.168.203.9@tcp:36:dd.0 00010000:00010000:0.0:1789302282.122372:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.122394:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.122408:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302282.122795:0:10111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789302282.122825:0:10111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5baecd1 reply state 00000000386906a1 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.122842:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.122869:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302282.122872:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789302282.122877:0:10111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789302282.123024:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+43:11212:x1876219101487616:12345-192.168.203.9@tcp:36:dd.0 Request processed in 1012us (3022us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789302282.123033:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 62 00000020:00080000:0.0:1789302282.123040:0:10111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789302282.434511:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302282.434708:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101487744 00000100:00100000:2.0:1789302282.434723:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101487744 00000100:00100000:2.0:1789302282.434809:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:2.0:1789302282.434822:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+43:11227:x1876219101487744:12345-192.168.203.9@tcp:101:stat.0 00010000:00010000:2.0:1789302282.434857:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302282.434885:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39978b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5aac expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.434986:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399792 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.435005:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399792 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.435018:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399792 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.435031:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399799 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.435039:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.435046:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.435213:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.435238:0:9541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a9e expref: 44 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.435247:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.435289:0:9541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a9e expref: 44 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.435306:0:9541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a9e expref: 44 pid: 9541 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302282.435323:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121505280:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302282.435453:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49a5a30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302282.439250:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121505280:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302282.439296:0:9541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302282.440861:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302282.440979:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101488000 00000100:00100000:1.0:1789302282.440990:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101488000 00000100:00100000:1.0:1789302282.441063:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:1.0:1789302282.441075:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+45:6634:x1876219101488000:12345-192.168.203.9@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789302282.441685:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+46:6634:x1876219101488000:12345-192.168.203.9@tcp:35:ldlm_bl.0 Request processed in 609us (834us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1789302282.441694:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:3.0:1789302282.444794:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302282.445654:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101488128 00000100:00100000:0.0:1789302282.445670:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101488128 00010000:00010000:0.0:1789302282.445726:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a9e expref: 46 pid: 9541 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302282.445828:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 56 00000100:00100000:0.0:1789302282.445840:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+46:2399:x1876219101488128:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302282.445859:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302282.445868:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a9e expref: 46 pid: 9541 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.445883:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a9e expref: 46 pid: 9541 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.445922:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399768 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a9e expref: 46 pid: 9541 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.445943:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302282.445948:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.445982:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.445993:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.446036:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302282.446171:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+45:2399:x1876219101488128:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 333us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302282.446178:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 56 00010000:00010000:2.0:1789302282.446488:0:9541:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446498:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302282.446569:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789302282.446582:0:9541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302282.446636:0:9541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446652:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446663:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399792 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446670:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399792 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446678:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399792 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446684:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302282.446690:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399792 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446698:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399792 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446709:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:2.0:1789302282.446712:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302282.446717:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399792 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446722:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399792 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446735:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446752:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399799 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446758:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399799 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446763:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302282.446767:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399799 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446773:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399799 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446781:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383963000) 00010000:00010000:2.0:1789302282.446784:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302282.446787:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399799 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446794:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399799 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446833:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39978b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aac expref: 45 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446854:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aac expref: 44 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.446862:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302282.446864:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302282.446873:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349000, rc 0) 00000100:00100000:2.0:1789302282.446910:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+44:11227:x1876219101487744:12345-192.168.203.9@tcp:101:stat.0 Request processed in 12091us (12416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302282.446918:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:0.0:1789302282.538763:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302282.540783:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101488384 00000100:00100000:2.0:1789302282.540803:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101488384 00000100:00100000:2.0:1789302282.540921:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 64 00000100:00100000:2.0:1789302282.540935:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+44:11233:x1876219101488384:12345-192.168.203.9@tcp:36:truncate.0 00010000:00010000:2.0:1789302282.541048:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302282.541085:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aac expref: 44 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.541178:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302282.541185:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302282.541422:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.541440:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.541453:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302282.541507:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:2.0:1789302282.541533:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba022b50 reply state 00000000862e728a transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.542063:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.542093:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302282.542096:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789302282.542100:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302282.542372:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+46:11233:x1876219101488384:12345-192.168.203.9@tcp:36:truncate.0 Request processed in 1436us (3630us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789302282.542382:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 64 00000020:00080000:2.0:1789302282.542389:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789302282.650469:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302282.791820:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302282.792867:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101488512 00000100:00100000:0.0:1789302282.792883:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101488512 00000100:00100000:0.0:1789302282.792980:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 65 00000100:00100000:0.0:1789302282.792995:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+46:11247:x1876219101488512:12345-192.168.203.9@tcp:101:stat.0 00010000:00010000:0.0:1789302282.793027:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302282.793067:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd3997ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ab3 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.793229:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd3997b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.793248:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd3997b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.793263:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd3997b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.793287:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd3997bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.793826:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd3997bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.793837:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd3997bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.793954:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.793965:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.793973:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302282.794033:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789302282.794038:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789302282.794205:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794230:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794240:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd3997b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794246:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd3997b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794254:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd3997b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794554:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311ce00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302282.794559:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd3997b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794569:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd3997b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794586:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:0.0:1789302282.794590:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302282.794596:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd3997b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794603:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd3997b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794620:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd3997bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794627:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd3997bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794633:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd3997bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794638:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311c000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302282.794641:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd3997bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794646:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd3997bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794666:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383963000) 00010000:00010000:0.0:1789302282.794669:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302282.794674:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd3997bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794682:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd3997bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794728:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd3997ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ab3 expref: 48 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794744:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ab3 expref: 47 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302282.794752:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302282.794755:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302282.794757:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311d800, rc 0) 00000100:00100000:0.0:1789302282.795177:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+47:11247:x1876219101488512:12345-192.168.203.9@tcp:101:stat.0 Request processed in 2183us (3370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302282.795188:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 65 00000100:00100000:3.0:1789302282.912769:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302282.913188:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101488768 00000100:00100000:2.0:1789302282.913202:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101488768 00000100:00100000:2.0:1789302282.913292:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 66 00000100:00100000:2.0:1789302282.913305:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+47:11257:x1876219101488768:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302282.913333:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302282.913363:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5aba expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302282.913753:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789302282.913885:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aba expref: 49 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.913913:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa9500) 00010000:00010000:2.0:1789302282.913917:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302282.913924:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aba expref: 49 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.913942:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349000, rc 0) 00000100:00100000:2.0:1789302282.914025:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+48:11257:x1876219101488768:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 722us (1272us total) trans 4294967342 rc 301/301 00000100:00100000:2.0:1789302282.914054:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 66 00000100:00100000:2.0:1789302282.917271:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302282.917757:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101489024 00000100:00100000:0.0:1789302282.917772:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101489024 00000100:00100000:0.0:1789302282.917917:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00100000:0.0:1789302282.917930:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+48:11257:x1876219101489024:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:0.0:1789302282.918294:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+49:11257:x1876219101489024:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 365us (1035us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789302282.918304:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00100000:1.0:1789302282.998719:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302282.998913:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101489280 00000100:00100000:2.0:1789302282.998925:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101489280 00000100:00100000:2.0:1789302282.999004:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 67 00000100:00100000:2.0:1789302282.999017:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+49:11263:x1876219101489280:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1789302282.999060:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302282.999088:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997d8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.999646:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.999667:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ab3 expref: 50 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.999678:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.999724:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ab3 expref: 50 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302282.999740:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ab3 expref: 50 pid: 10111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302282.999756:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121505408:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302283.000001:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b5351c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302283.008841:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302283.009717:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101489408 00000100:00100000:0.0:1789302283.009732:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101489408 00010000:00010000:0.0:1789302283.009794:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ab3 expref: 51 pid: 10111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302283.009856:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 57 00000100:00100000:0.0:1789302283.009869:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+51:2398:x1876219101489408:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302283.009889:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302283.009897:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ab3 expref: 51 pid: 10111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.009924:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ab3 expref: 51 pid: 10111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.009956:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302283.009963:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.009976:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.009985:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.010010:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302283.010917:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+51:2398:x1876219101489408:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1033us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302283.010929:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 57 00010000:00010000:2.0:1789302283.015227:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd3997c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ab3 expref: 50 pid: 10111 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302283.015268:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121505408:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302283.015309:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.015321:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.015328:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302283.015358:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789302283.015584:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac1 expref: 51 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.015604:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac1 expref: 50 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.015615:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302283.015618:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789302283.015623:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348800, rc 0) 00000100:00100000:2.0:1789302283.015699:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+50:11263:x1876219101489280:12345-192.168.203.9@tcp:101:bash.0 Request processed in 16684us (16994us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789302283.015709:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 67 00000100:00100000:0.0:1789302283.023720:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302283.023921:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101489664 00000100:00100000:2.0:1789302283.023935:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101489664 00000100:00100000:2.0:1789302283.024026:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 68 00000100:00100000:2.0:1789302283.024047:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+50:11263:x1876219101489664:12345-192.168.203.9@tcp:36:bash.0 00010000:00010000:2.0:1789302283.024726:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.024750:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.024763:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302283.024819:0:10111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:2.0:1789302283.024850:0:10111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008323fa99 reply state 00000000d811e881 transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.024865:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.024873:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302283.024876:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789302283.024882:0:10111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302283.025345:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+53:11263:x1876219101489664:12345-192.168.203.9@tcp:36:bash.0 Request processed in 1297us (1635us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789302283.025354:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 68 00000020:00080000:2.0:1789302283.025361:0:10111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789302283.032068:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302283.032765:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101489792 00000100:00100000:2.0:1789302283.032781:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101489792 00000100:00100000:2.0:1789302283.032886:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 69 00000100:00100000:2.0:1789302283.032972:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+53:11263:x1876219101489792:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1789302283.033020:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302283.033056:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3997f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ac8 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.033749:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd3997fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.033773:0:9541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac1 expref: 54 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.033783:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd3997fb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.033840:0:9541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac1 expref: 54 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.033859:0:9541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac1 expref: 54 pid: 6531 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302283.033878:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121505536:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302283.034726:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b5351c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302283.040709:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302283.040743:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121505536:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302283.040802:0:9541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd3997fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302283.041413:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101489920 00000100:00100000:3.0:1789302283.041634:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101489920 00010000:00010000:3.0:1789302283.041698:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac1 expref: 55 pid: 6531 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302283.041764:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 58 00000100:00100000:3.0:1789302283.041777:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7face00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+55:2399:x1876219101489920:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302283.041799:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302283.041809:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac1 expref: 55 pid: 6531 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.041826:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac1 expref: 55 pid: 6531 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.041856:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd3997df lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac1 expref: 55 pid: 6531 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.041876:0:13201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:3.0:1789302283.041977:0:13201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd3997fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.041992:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd3997fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.042002:0:13201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd3997fb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.042211:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302283.042316:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7face00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+54:2399:x1876219101489920:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 540us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302283.042327:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 58 00010000:00010000:2.0:1789302283.044555:0:9541:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd3997fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.044580:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd3997fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302283.044676:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789302283.044707:0:9541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302283.044743:0:9541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd3997fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.044800:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd3997f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac8 expref: 54 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.044827:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd3997fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac8 expref: 53 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.044837:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302283.044841:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302283.044846:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349e00, rc 0) 00000100:00100000:2.0:1789302283.045297:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+53:11263:x1876219101489792:12345-192.168.203.9@tcp:101:bash.0 Request processed in 12395us (13247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302283.045307:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 69 00000100:00100000:0.0:1789302283.049697:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302283.049809:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101490176 00000100:00100000:1.0:1789302283.049823:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101490176 00000100:00100000:1.0:1789302283.049992:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00100000:1.0:1789302283.050005:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+53:11263:x1876219101490176:12345-192.168.203.9@tcp:35:bash.0 00000100:00100000:1.0:1789302283.050405:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+54:11263:x1876219101490176:12345-192.168.203.9@tcp:35:bash.0 Request processed in 401us (721us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1789302283.051839:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00100000:3.0:1789302283.149705:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302283.149981:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101490432 00000100:00100000:2.0:1789302283.149994:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101490432 00000100:00100000:2.0:1789302283.150103:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 70 00000100:00100000:2.0:1789302283.150158:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+54:11273:x1876219101490432:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302283.150192:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302283.150229:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5acf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302283.154096:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789302283.154930:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399802 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5acf expref: 56 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.154954:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa9500) 00010000:00010000:3.0:1789302283.154957:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302283.154964:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5acf expref: 56 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.154986:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349c00, rc 0) 00000100:00100000:3.0:1789302283.155235:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+55:11273:x1876219101490432:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 5120us (5541us total) trans 4294967348 rc 301/301 00000100:00100000:3.0:1789302283.155246:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 70 00000100:00100000:3.0:1789302283.159972:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302283.160099:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101490560 00000100:00100000:0.0:1789302283.160334:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101490560 00000100:00100000:0.0:1789302283.160591:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 71 00000100:00100000:0.0:1789302283.160604:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+55:11273:x1876219101490560:12345-192.168.203.9@tcp:34:lfs.0 00010000:00010000:0.0:1789302283.160712:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399810 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.160734:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399810 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.160749:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399810 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.160763:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399817 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.160771:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399817 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.160777:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399817 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.160869:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39981e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.160879:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39981e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.160887:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39981e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789302283.160994:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39981e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161010:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399810 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161017:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399810 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161026:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399810 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161033:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311d600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302283.161037:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399810 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161045:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399810 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161060:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:0.0:1789302283.161063:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302283.161070:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399810 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161076:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399810 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161092:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399817 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161098:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399817 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161110:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399817 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161177:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311da00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302283.161181:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399817 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161188:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399817 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161197:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383963000) 00010000:00010000:0.0:1789302283.161200:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302283.161203:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399817 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161209:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399817 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161230:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39981e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161237:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39981e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161243:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39981e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161248:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311cc00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302283.161251:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39981e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161269:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39981e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161277:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302283.161280:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302283.161283:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39981e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.161289:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39981e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302283.161431:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+55:11273:x1876219101490560:12345-192.168.203.9@tcp:34:lfs.0 Request processed in 799us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302283.161442:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 71 00000100:00100000:1.0:1789302283.171847:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302283.173186:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101490816 00000100:00100000:0.0:1789302283.173202:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101490816 00000100:00100000:1.0:1789302283.173590:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00100000:1.0:1789302283.173607:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+55:11273:x1876219101490816:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:1.0:1789302283.174305:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+56:11273:x1876219101490816:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 699us (2471us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789302283.174317:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00100000:3.0:1789302283.225554:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302283.225712:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101491072 00000100:00100000:2.0:1789302283.225726:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101491072 00000100:00100000:2.0:1789302283.225865:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:2.0:1789302283.225879:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+56:11276:x1876219101491072:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302283.225931:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302283.225957:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399825 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ad6 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226069:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39982c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226087:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39982c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226101:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39982c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226169:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399833 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226177:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226184:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226597:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39983a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226609:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39983a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226617:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39983a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302283.226630:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789302283.226750:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39982c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226759:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39982c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226766:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39982c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226773:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302283.226778:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39982c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226787:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39982c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226801:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:2.0:1789302283.226804:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302283.226811:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39982c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226817:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39982c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226832:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226838:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399833 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226844:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399833 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226849:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302283.226858:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399833 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226864:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399833 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226872:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383963000) 00010000:00010000:2.0:1789302283.226875:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302283.226877:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399833 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.226884:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399833 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.227379:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399825 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ad6 expref: 59 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.227410:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39983a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ad6 expref: 58 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.227419:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302283.227422:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302283.227425:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348800, rc 0) 00000100:00100000:2.0:1789302283.227521:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+58:11276:x1876219101491072:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1645us (1981us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789302283.227531:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:3.0:1789302283.232929:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302283.234552:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101491328 00000100:00100000:0.0:1789302283.234575:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101491328 00000100:00100000:0.0:1789302283.234681:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5 00000100:00100000:0.0:1789302283.234692:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+58:2399:x1876219101491328:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302283.234711:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302283.234742:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39983a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ad6 expref: 58 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.234767:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302283.234773:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302283.234850:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+57:2399:x1876219101491328:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 160us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302283.234878:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5 00000100:00100000:3.0:1789302283.235606:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302283.235760:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101491200 00000100:00100000:2.0:1789302283.235769:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101491200 00000100:00100000:2.0:1789302283.235825:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 73 00000100:00100000:2.0:1789302283.235835:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+57:11276:x1876219101491200:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:2.0:1789302283.235927:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399848 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.235946:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.235961:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.236002:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.236009:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399848 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.236016:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.236022:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302283.236027:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.236035:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399848 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.236045:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302283.236049:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302283.236053:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399848 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.236060:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399848 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302283.236167:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+57:11276:x1876219101491200:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 332us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302283.236175:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 73 00000100:00100000:3.0:1789302283.239080:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302283.239294:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101491584 00000100:00100000:0.0:1789302283.239307:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101491584 00000100:00100000:0.0:1789302283.239376:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:0.0:1789302283.239396:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+57:11276:x1876219101491584:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:0.0:1789302283.239720:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+58:11276:x1876219101491584:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 334us (653us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1789302283.239729:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17 00000001:00080000:2.0:1789302283.244871:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:2.0:1789302283.244969:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789302283.244996:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cc484ed2b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789302283.245002:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc484e05700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cc484ed2300 00000020:00080000:2.0:1789302283.245006:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc484e05900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cc488c15600 00000020:00080000:0.0:1789302283.247269:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1789302283.247577:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789302283.248792:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302283.248829:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121505664:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789302283.248944:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302283.249178:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121505664 00000100:00100000:3.0:1789302283.249189:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121505664 00000100:00100000:3.0:1789302283.249279:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302283.249293:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121505664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789302283.249330:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1789302283.249382:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa69609, atime: 0x6aa69609, ctime: 0x6aa69609, blocks: 0x8 00010000:00010000:3.0:1789302283.249393:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39984f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.249414:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1789302283.249420:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302283.249428:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39984f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.249450:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39984f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.249462:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39984f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.249472:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39984f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.249493:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789302283.249691:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1876219121505664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 401us (747us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789302283.249699:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789302283.249729:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302283.249736:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39984f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.249746:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302283.249751:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39984f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.249761:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39984f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.249782:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39984f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.249790:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39984f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.249813:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302283.249815:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302283.249817:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789302283.249863:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc4b7fb2a00/2, rc 0, transno 4294967302 00000100:00100000:3.0:1789302283.249871:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121505664:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1789302283.250307:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789302283.251976:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252000:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252011:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252019:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538e400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302283.252026:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252035:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252059:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cc488eace00) 00010000:00010000:1.0:1789302283.252062:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302283.252069:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252106:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e400/0x1ff82925bd399634 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252274:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252281:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252287:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252292:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538fe00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302283.252296:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252303:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252312:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302283.252315:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302283.252318:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252325:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fe00/0x1ff82925bd39963b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252343:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252349:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252362:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252367:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302283.252370:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252378:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252516:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383963000) 00010000:00010000:1.0:1789302283.252518:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302283.252522:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252528:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39967a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252548:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252554:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252560:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252565:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311de00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302283.252568:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252584:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252593:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:1.0:1789302283.252596:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302283.252599:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252605:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399784 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252617:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252622:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252627:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252632:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302283.252634:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252640:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252647:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:1.0:1789302283.252650:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302283.252653:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252667:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3997a7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252679:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252684:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252689:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252693:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302283.252696:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252702:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252708:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:1.0:1789302283.252710:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302283.252713:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302283.252718:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd3997ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302283.412074:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302283.412447:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101491840 00000100:00100000:0.0:1789302283.412462:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101491840 00000100:00100000:0.0:1789302283.412561:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 74 00000100:00100000:0.0:1789302283.412577:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+12:11294:x1876219101491840:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:0.0:1789302283.412616:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302283.412648:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399856 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5add expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.412818:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd39985d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.412837:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd39985d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.412871:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd39985d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302283.412888:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789302283.413060:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399856 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5add expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.413083:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd39985d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5add expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.413093:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302283.413096:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789302283.413101:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311d600, rc 0) 00000100:00100000:0.0:1789302283.413243:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+14:11294:x1876219101491840:12345-192.168.203.9@tcp:101:cat.0 Request processed in 670us (1186us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789302283.413251:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 74 00000100:00100000:3.0:1789302283.457260:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302283.465421:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101491968 00000100:00100000:2.0:1789302283.465444:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101491968 00000100:00100000:2.0:1789302283.465553:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 75 00000100:00100000:2.0:1789302283.465566:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:11295:x1876219101491968:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302283.465599:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302283.465625:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39986b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ae4 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.466587:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399872 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.466609:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.466625:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302283.466686:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789302283.466691:0:9541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302283.466793:0:9541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.466833:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39986b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ae4 expref: 16 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.466856:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399872 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ae4 expref: 15 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302283.466865:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:2.0:1789302283.466868:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302283.466872:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348e00, rc 0) 00000100:00100000:2.0:1789302283.468482:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+15:11295:x1876219101491968:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 2903us (11223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302283.468497:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 75 00000100:00100000:3.0:1789302283.486884:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302283.487015:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101492352 00000100:00100000:0.0:1789302283.487030:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101492352 00000100:00100000:0.0:1789302283.487107:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:0.0:1789302283.487171:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+15:11295:x1876219101492352:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:0.0:1789302283.487592:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+16:11295:x1876219101492352:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 424us (722us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789302283.487602:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:3.0:1789302283.491291:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302283.491593:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101492480 00000100:00100000:0.0:1789302283.491608:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101492480 00000100:00100000:0.0:1789302283.491695:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6 00000100:00100000:0.0:1789302283.491715:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+16:11295:x1876219101492480:12345-192.168.203.9@tcp:103:lfs.0 00010000:00010000:0.0:1789302283.491753:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789302283.491786:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd3997fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ac8 expref: 16 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.491814:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd39985d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5add expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.491828:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f200/0x1ff82925bd3996f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a82 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.491841:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302283.491847:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302283.491930:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+13:11295:x1876219101492480:12345-192.168.203.9@tcp:103:lfs.0 Request processed in 225us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302283.491939:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6 00000100:00100000:0.0:1789302283.498871:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302283.499401:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101492608 00000100:00100000:3.0:1789302283.499416:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101492608 00000100:00100000:3.0:1789302283.499497:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 76 00000100:00100000:3.0:1789302283.499511:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+13:11295:x1876219101492608:12345-192.168.203.9@tcp:58:lfs.0 00010000:00010000:3.0:1789302283.499698:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399879 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.499729:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399879 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302283.499743:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399879 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302283.500070:0:6532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302283.502464:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789302283.502613:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789302283.502798:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+13:11295:x1876219101492608:12345-192.168.203.9@tcp:58:lfs.0 Request processed in 3281us (3933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302283.502811:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 76 00000100:00100000:2.0:1789302283.535472:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302283.535721:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101492736 00000100:00100000:0.0:1789302283.535737:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101492736 00000100:00100000:0.0:1789302283.535812:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 77 00000100:00100000:0.0:1789302283.535825:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+13:11297:x1876219101492736:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1789302283.535854:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302283.535881:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399880 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5aeb expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536008:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd399887 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536038:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd399887 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536051:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd399887 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536070:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd39988e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536078:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd39988e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536086:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd39988e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536242:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536252:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536260:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302283.536330:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789302283.536335:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789302283.536360:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536376:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536852:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd399887 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536860:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd399887 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536868:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd399887 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536875:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311c800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302283.536880:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd399887 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536889:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd399887 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536961:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:0.0:1789302283.536964:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302283.536970:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd399887 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536977:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd399887 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.536994:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd39988e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.537000:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd39988e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.537005:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd39988e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.537019:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311dc00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302283.537022:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd39988e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.537029:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd39988e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.537037:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc488eac100) 00010000:00010000:0.0:1789302283.537039:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302283.537041:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd39988e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.537047:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd39988e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.537096:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399880 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aeb expref: 15 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.537159:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aeb expref: 14 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302283.537168:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302283.537170:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302283.537173:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311d600, rc 0) 00000100:00100000:2.0:1789302283.538205:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+14:11297:x1876219101492736:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 2371us (2738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302283.538229:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 77 00010000:00010000:3.0:1789302283.669106:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302283.860399:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302283.860428:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121505792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302283.860522:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302283.860608:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121505792 00000100:00100000:0.0:1789302283.860630:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121505792 00000100:00100000:0.0:1789302283.860700:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789302283.860713:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121505792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302283.860750:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302283.860802:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121505792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302283.860810:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1789302283.860835:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302283.860880:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121505792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302283.861496:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302283.861509:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121505920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302283.861549:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302283.861591:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121505920 00000100:00100000:0.0:1789302283.861597:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121505920 00000100:00100000:0.0:1789302283.861634:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789302283.861643:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121505920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302283.861657:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302283.861694:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121505920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302283.861701:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1789302283.861717:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302283.861741:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121505920:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1789302284.125616:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302284.125630:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789302284.125676:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789302284.125689:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789302284.125884:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121506048:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789302284.126008:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302284.129615:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121506048:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789302284.134249:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302284.134304:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101492864 00000100:00100000:1.0:1789302284.134318:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101492864 00000100:00100000:1.0:1789302284.134415:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 78 00000100:00100000:1.0:1789302284.134427:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:11308:x1876219101492864:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789302284.134470:0:9541:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789302284.134631:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:11308:x1876219101492864:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 207us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302284.134639:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 78 00000100:00080000:0.0:1789302284.134685:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302284.144276:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302284.144535:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101492992 00000100:00100000:2.0:1789302284.144548:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101492992 00000100:00100000:2.0:1789302284.144633:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 79 00000100:00100000:2.0:1789302284.144647:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+14:11308:x1876219101492992:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789302284.144741:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39989c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.144762:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39989c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.144792:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39989c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.148507:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3998a3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.148534:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3998a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.148546:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3998a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.148584:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3998aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.148594:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3998aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.148601:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3998aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302284.148655:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789302284.148659:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302284.148677:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3998aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.148923:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39989c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.148931:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39989c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.148955:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39989c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.148961:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302284.148966:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39989c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149071:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39989c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149085:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:2.0:1789302284.149088:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302284.149093:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39989c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149098:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39989c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149132:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3998a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149139:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3998a3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149144:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3998a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149148:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302284.149151:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3998a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149167:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3998a3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149176:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8cc4adc10800) 00010000:00010000:2.0:1789302284.149178:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302284.149181:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3998a3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149187:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd3998a3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149280:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3998aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149287:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3998aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149292:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3998aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149297:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302284.149300:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3998aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149307:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3998aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149317:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302284.149319:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302284.149322:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3998aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.149340:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd3998aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302284.149444:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+14:11308:x1876219101492992:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 4796us (5179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302284.149455:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 79 00000100:00100000:1.0:1789302284.160639:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.163383:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101493248 00000100:00100000:3.0:1789302284.163406:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101493248 00000100:00100000:3.0:1789302284.163507:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 80 00000100:00100000:3.0:1789302284.163524:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+14:11308:x1876219101493248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302284.163554:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302284.163583:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3998b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5af2 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.163762:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3998b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.163782:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3998b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.163795:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3998b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302284.163809:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789302284.163914:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3998b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.163923:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3998b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.163932:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3998b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.163939:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2179200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302284.163944:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3998b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.163952:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3998b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.163968:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:3.0:1789302284.163972:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302284.163978:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3998b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.163996:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd3998b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.164052:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3998b1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5af2 expref: 16 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.164064:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:3.0:1789302284.164066:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302284.164070:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd3998b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5af2 expref: 16 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.164082:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178800, rc 0) 00000100:00100000:3.0:1789302284.164225:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+15:11308:x1876219101493248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 705us (3598us total) trans 4294967354 rc 301/301 00000100:00100000:3.0:1789302284.164235:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 80 00000100:00100000:1.0:1789302284.169520:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.171287:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101493376 00000100:00100000:3.0:1789302284.171307:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101493376 00000100:00100000:3.0:1789302284.171409:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 81 00000100:00100000:3.0:1789302284.171424:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+15:11308:x1876219101493376:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789302284.171469:0:6530:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789302284.171633:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+15:11308:x1876219101493376:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 213us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302284.171642:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 81 00000100:00100000:3.0:1789302284.176304:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302284.178075:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101493632 00000100:00100000:0.0:1789302284.178098:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101493632 00000100:00100000:0.0:1789302284.178223:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 82 00000100:00100000:0.0:1789302284.178252:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+15:11308:x1876219101493632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302284.178281:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302284.178286:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789302284.178321:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399872 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ae4 expref: 15 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.178347:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:0.0:1789302284.178352:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302284.178370:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd3998c6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5af9 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789302284.178872:0:6532:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789302284.179053:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd3998cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.179069:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd3998cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.179082:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd3998cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.179182:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd3998c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5af9 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.179202:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd3998cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5af9 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.179220:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc488eac100) 00010000:00010000:0.0:1789302284.179224:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302284.179236:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311dc00, rc 0) 00000100:00100000:0.0:1789302284.179319:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+16:11308:x1876219101493632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1070us (3030us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789302284.179329:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 82 00000100:00100000:2.0:1789302284.187527:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302284.188837:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101493888 00000100:00100000:1.0:1789302284.188849:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101493888 00000100:00100000:1.0:1789302284.189203:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 83 00000100:00100000:1.0:1789302284.189224:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+16:11308:x1876219101493888:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302284.189282:0:10111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302284.189309:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd3998cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5af9 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189328:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc488eac100) 00010000:00010000:1.0:1789302284.189339:0:10111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302284.189360:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998db lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189388:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189398:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189414:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x9e6cd09f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189421:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9e6cd09f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189427:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9e6cd09f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189473:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189480:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998db lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189486:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189491:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302284.189495:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189501:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189508:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302284.189516:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302284.189521:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998db lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189526:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189536:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9e6cd09f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189542:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9e6cd09f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189547:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9e6cd09f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189551:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302284.189553:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9e6cd09f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189558:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9e6cd09f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189564:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x9e6cd09f (ffff8cc383963000) 00010000:00010000:1.0:1789302284.189566:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302284.189569:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9e6cd09f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.189573:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9e6cd09f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302284.189653:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+15:11308:x1876219101493888:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 440us (2133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302284.189667:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 83 00000100:00100000:2.0:1789302284.196938:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302284.197048:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101494016 00000100:00100000:0.0:1789302284.197065:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101494016 00000100:00100000:1.0:1789302284.197231:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 84 00000100:00100000:1.0:1789302284.197251:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+15:11308:x1876219101494016:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302284.197275:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302284.197297:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b00 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.197336:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.197350:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.197362:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.197472:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b00 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.197491:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b00 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.197499:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:1.0:1789302284.197502:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302284.197505:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2800, rc 0) 00000100:00100000:1.0:1789302284.197575:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+16:11308:x1876219101494016:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 332us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302284.197592:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 84 00000100:00100000:1.0:1789302284.213761:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302284.213824:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101494272 00000100:00100000:1.0:1789302284.213837:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101494272 00000100:00100000:1.0:1789302284.213920:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 85 00000100:00100000:1.0:1789302284.213933:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+16:11308:x1876219101494272:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302284.214545:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.214568:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.214583:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789302284.214814:0:9541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1789302284.214825:0:9541:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360257711518ns, next at 361257708568ns, rc = 0 00000004:00010000:1.0:1789302284.214887:0:9541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ac60205 reply state 0000000018492e49 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.214916:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.214925:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:1.0:1789302284.214928:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789302284.214934:0:9541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302284.215534:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+18:11308:x1876219101494272:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 1599us (1785us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789302284.215544:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 85 00000100:00100000:2.0:1789302284.219639:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302284.224590:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101494400 00000100:00100000:0.0:1789302284.224603:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101494400 00000100:00100000:0.0:1789302284.224666:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 86 00000100:00100000:0.0:1789302284.224678:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+18:11308:x1876219101494400:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302284.224713:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302284.224733:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd3998fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b07 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.224792:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd3998fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b07 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.224808:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd3998fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b07 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.224825:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:0.0:1789302284.224828:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302284.224832:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311c800, rc 0) 00000100:00100000:0.0:1789302284.224902:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+19:11308:x1876219101494400:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 227us (5271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302284.224910:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 86 00000100:00100000:1.0:1789302284.230161:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.230345:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101494528 00000100:00100000:3.0:1789302284.230359:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101494528 00000100:00100000:3.0:1789302284.230430:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 33 00000100:00100000:3.0:1789302284.230440:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2395:x1876219101494528:12345-192.168.203.9@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789302284.230485:0:8852:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp t0 exp 0000000000000000 cur 360 last 0 00000020:00000080:3.0:1789302284.230525:0:8852:0:(genops.c:1384:class_connect()) connect: client c76ee310-c3b4-4286-aaea-77936c269d98, cookie 0x1ff82925bd399905 00002000:00100000:3.0:1789302284.230540:0:8852:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c76ee310-c3b4-4286-aaea-77936c269d98/ffff8cc38422f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789302284.230553:0:8852:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789302284.230652:0:8852:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789302284.230690:0:8852:0:(import.c:65:import_set_state_nolock()) ffff8cc38422e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302284.230787:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2395:x1876219101494528:12345-192.168.203.9@tcp:8:lhsmtool_posix.0 Request processed in 347us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302284.230795:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 33 00000100:00100000:3.0:1789302284.244719:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302284.244834:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101494656 00000100:00100000:2.0:1789302284.244848:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101494656 00000100:00100000:2.0:1789302284.244980:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 34 00000100:00100000:2.0:1789302284.245001:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:0:x1876219101494656:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789302284.245839:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789302284.251795:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1789302284.251814:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000100:00100000:3.0:1789302284.254584:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:0:x1876219101494656:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 9583us (9878us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789302284.254597:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 34 00000100:00100000:1.0:1789302284.283156:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302284.283668:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101494912 00000100:00100000:0.0:1789302284.283691:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101494912 00000100:00100000:0.0:1789302284.283772:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00100000:0.0:1789302284.283782:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+19:11308:x1876219101494912:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789302284.284002:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+20:11308:x1876219101494912:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 219us (904us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789302284.284014:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00100000:1.0:1789302284.291248:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302284.291303:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101495168 00000100:00100000:1.0:1789302284.291315:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101495168 00000100:00100000:1.0:1789302284.291382:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 87 00000100:00100000:1.0:1789302284.291583:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+20:11308:x1876219101495168:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789302284.291729:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+20:11308:x1876219101495168:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 150us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302284.291738:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 87 00000100:00100000:3.0:1789302284.299580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.300533:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101495296 00000100:00100000:3.0:1789302284.300546:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101495296 00000100:00100000:3.0:1789302284.300600:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 88 00000100:00100000:3.0:1789302284.300610:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+20:11308:x1876219101495296:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302284.300629:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302284.300650:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd39990c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b0e expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.301644:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399913 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.301674:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399913 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.302434:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399913 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302284.302781:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302284.302804:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399913 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.302838:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd39990c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b0e expref: 22 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.302861:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399913 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b0e expref: 21 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.302870:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:3.0:1789302284.302874:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789302284.302878:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2179200, rc 0) 00000100:00100000:3.0:1789302284.303010:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+21:11308:x1876219101495296:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2399us (3434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302284.303544:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 88 00000100:00100000:1.0:1789302284.315072:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.315785:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101495424 00000100:00100000:3.0:1789302284.315796:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101495424 00000100:00100000:3.0:1789302284.315853:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 35 00000100:00100000:3.0:1789302284.315863:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101495424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302284.315880:0:8852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302284.315924:0:8852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d42995b/0x1ff82925bd39991a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b15 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302284.315949:0:8852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6960c, blocks: 0x0 00010000:00010000:3.0:1789302284.315969:0:8852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1789302284.315974:0:8852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302284.315984:0:8852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d42995b/0x1ff82925bd39991a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b15 expref: 6 pid: 8852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.316001:0:8852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d42995b/0x1ff82925bd39991a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b15 expref: 6 pid: 8852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.316014:0:8852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982800, rc 0) 00000100:00100000:3.0:1789302284.316067:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101495424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 205us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302284.316075:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 35 00000100:00100000:1.0:1789302284.320234:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302284.322145:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101495680 00000100:00100000:0.0:1789302284.322167:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101495680 00000100:00100000:0.0:1789302284.322256:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 89 00000100:00100000:0.0:1789302284.322269:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+21:11308:x1876219101495680:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789302284.322425:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+21:11308:x1876219101495680:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 158us (2200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302284.322448:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 89 00000100:00100000:1.0:1789302284.337782:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.342417:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101495808 00000100:00100000:3.0:1789302284.342434:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101495808 00000100:00100000:3.0:1789302284.343462:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 36 00000100:00100000:3.0:1789302284.343483:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:11308:x1876219101495808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302284.343507:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302284.343530:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b1c expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.343565:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d42995b/0x1ff82925bd39991a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b15 expref: 7 pid: 8852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.343599:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302284.343603:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302284.343610:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.343661:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d42995b/0x1ff82925bd39991a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b15 expref: 7 pid: 8852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.343676:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d42995b/0x1ff82925bd39991a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b15 expref: 7 pid: 8852 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302284.343757:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121506176:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302284.343857:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302284.347925:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121506176:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302284.347971:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.348004:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982c00, rc 0) 00000100:00100000:3.0:1789302284.348078:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:11308:x1876219101495808:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4604us (10404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302284.348088:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 36 00000100:00100000:0.0:1789302284.354196:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.354311:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101495936 00000100:00100000:3.0:1789302284.354325:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101495936 00010000:00010000:3.0:1789302284.354383:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d42995b/0x1ff82925bd39991a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b15 expref: 7 pid: 8852 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302284.354456:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 59 00000100:00100000:3.0:1789302284.354469:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101495936:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302284.354488:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302284.354516:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d42995b/0x1ff82925bd39991a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b15 expref: 7 pid: 8852 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.354532:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d42995b/0x1ff82925bd39991a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b15 expref: 7 pid: 8852 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.354561:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d42995b/0x1ff82925bd39991a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b15 expref: 7 pid: 8852 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.354580:0:10408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302284.354585:0:10408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302284.354594:0:10408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.354606:0:10408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.354655:0:10408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302284.354673:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10408:1876219121506304:192.168.203.9@tcp:105: 00000100:00100000:3.0:1789302284.354848:0:10408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302284.367290:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302284.367365:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101496064 00000100:00100000:2.0:1789302284.367383:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101496064 00000100:00100000:3.0:1789302284.367436:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10408:1876219121506304:192.168.203.9@tcp:105: 00002000:00100000:2.0:1789302284.367461:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8cc4b7fac000 x1876219101496064/t0(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:615/0 lens 504/0 e 0 to 0 dl 1789302295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1789302284.367464:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1789302284.367479:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4b7fac000 with x1876219101496064 ext(0->8) 00002000:00010000:2.0:1789302284.367487:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc4b7fac000 00000100:00100000:3.0:1789302284.367514:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101495936:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 13046us (13330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302284.367527:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 59 00000100:00100000:2.0:1789302284.367539:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 0 00000100:00100000:2.0:1789302284.367556:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101496064:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789302284.370337:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101496064:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 2777us (3046us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789302284.370365:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 0 00002000:00100000:2.0:1789302284.370376:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8cc4b7fac000 x1876219101496064/t4294967303(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:615/0 lens 504/448 e 0 to 0 dl 1789302295 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302284.370387:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4b7fac000 with x1876219101496064 ext(0->8) 00002000:00010000:2.0:1789302284.370394:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc4b7fac000 00000100:00100000:3.0:1789302284.372666:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302284.377889:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101496192 00000100:00100000:1.0:1789302284.377911:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101496192 00000100:00100000:1.0:1789302284.378006:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 90 00000100:00100000:1.0:1789302284.378019:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+21:11308:x1876219101496192:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789302284.407709:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:2.0:1789302284.407741:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789302284.407792:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1789302284.408095:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+15:11308:x1876219101496192:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 30068us (35425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302284.408142:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 90 00000100:00100000:2.0:1789302284.408183:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302284.408203:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121506432:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789302284.408309:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302284.408376:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121506432 00000100:00100000:2.0:1789302284.408385:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121506432 00000100:00100000:2.0:1789302284.408431:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789302284.408440:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121506432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789302284.408591:0:8852:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789302284.408596:0:8852:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789302284 00002000:00010000:2.0:1789302284.408599:0:8852:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789302284.408601:0:8852:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789302284 -> 1789302284 00002000:00010000:2.0:1789302284.408604:0:8852:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789302284.408635:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876219121506432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (327us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789302284.408652:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789302284.408875:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc498ad5880/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789302284.408882:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121506432:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789302284.409440:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.409453:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.409462:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.409469:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302284.409474:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.409482:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.409510:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:0.0:1789302284.409513:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789302284.409519:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.409526:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd3998f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789302284.409557:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1789302284.409570:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789302284.411745:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302284.412899:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101496320 00000100:00100000:2.0:1789302284.412917:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101496320 00000100:00100000:2.0:1789302284.413246:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 38 00000100:00100000:2.0:1789302284.413263:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+8:2399:x1876219101496320:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789302284.415084:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1789302284.415098:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1789302284.415302:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101496320:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2041us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302284.415312:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 38 00000100:00100000:3.0:1789302284.420800:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302284.420866:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101496576 00000100:00100000:2.0:1789302284.420876:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101496576 00000100:00100000:2.0:1789302284.420934:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 91 00000100:00100000:2.0:1789302284.420944:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+14:11308:x1876219101496576:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789302284.420991:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302284.421015:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399913 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b0e expref: 14 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.421032:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:2.0:1789302284.421038:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302284.421064:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.421079:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.421090:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302284.421248:0:6530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004f64771 reply state 000000006dedebeb transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.421261:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.421267:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:2.0:1789302284.421270:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789302284.421272:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302284.421358:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+15:11308:x1876219101496576:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 415us (567us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1789302284.421365:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 91 00000100:00100000:3.0:1789302284.424331:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302284.424395:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101496704 00000100:00100000:0.0:1789302284.424403:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101496704 00000100:00100000:0.0:1789302284.424460:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 39 00000100:00100000:0.0:1789302284.424470:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101496704:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789302284.424619:0:8852:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789302284.424623:0:8852:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789302284 -> 1789302283 00002000:00010000:0.0:1789302284.424626:0:8852:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789302281 00002000:00010000:0.0:1789302284.424629:0:8852:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789302284 -> 1789302283 00002000:00010000:0.0:1789302284.424631:0:8852:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789302284.424685:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101496704:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 216us (361us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789302284.424693:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 39 00000100:00100000:3.0:1789302284.429541:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302284.429608:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101496960 00000100:00100000:0.0:1789302284.429617:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101496960 00000100:00100000:0.0:1789302284.429679:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 92 00000100:00100000:0.0:1789302284.429690:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+15:11308:x1876219101496960:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789302284.429761:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.429779:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b00 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.429789:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.429821:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b00 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.429834:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b00 expref: 15 pid: 6530 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302284.429848:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7fadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6532:1876219121506560:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302284.429934:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484e85f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302284.444860:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.445393:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7fadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6532:1876219121506560:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302284.445512:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302284.448443:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101497088 00000100:00100000:2.0:1789302284.448457:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101497088 00010000:00010000:2.0:1789302284.448504:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b00 expref: 16 pid: 6530 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302284.448566:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:2.0:1789302284.448576:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+16:2399:x1876219101497088:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302284.448591:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302284.448598:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b00 expref: 16 pid: 6530 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.448609:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b00 expref: 16 pid: 6530 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.448647:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd3998f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b00 expref: 16 pid: 6530 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.448664:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:2.0:1789302284.448669:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.448678:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.448685:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.448709:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302284.448762:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+15:2399:x1876219101497088:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 188us (3911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302284.448770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 60 00010000:00010000:3.0:1789302284.449248:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.449259:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.449298:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.449306:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.449325:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.449331:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311d800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302284.449336:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.449354:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.449365:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:3.0:1789302284.449368:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789302284.449373:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.449379:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39992f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302284.449424:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+14:11308:x1876219101496960:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 19736us (19893us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789302284.449433:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 92 00000100:00100000:3.0:1789302284.455074:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302284.455223:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101497216 00000100:00100000:2.0:1789302284.455233:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101497216 00000100:00100000:2.0:1789302284.455357:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 40 00000100:00100000:2.0:1789302284.455367:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101497216:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789302284.455475:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.455497:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.455520:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302284.455525:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302284.455530:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.455628:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.455643:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 7 pid: 8447 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302284.455658:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121506688:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302284.455737:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382912240 going to sleep for 11 seconds 00000100:00100000:3.0:1789302284.463353:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302284.463484:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121506688:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302284.463511:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302284.463632:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101497344 00000100:00100000:0.0:1789302284.463640:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101497344 00010000:00010000:0.0:1789302284.463675:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 8 pid: 8447 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302284.463710:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:0.0:1789302284.463718:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+8:2399:x1876219101497344:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302284.463733:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302284.463754:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 8 pid: 8447 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.463786:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 8 pid: 8447 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.463807:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399921 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b1c expref: 8 pid: 8447 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.463823:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302284.463828:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302284.463833:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.463842:0:13201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.466180:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302284.466280:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101497344:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 2555us (2939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302284.466294:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 61 00010000:00010000:2.0:1789302284.469480:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.469499:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.469532:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.469626:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.469635:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.469644:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348600 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302284.469649:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.469658:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.469680:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.469688:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033901022/0x1ff82925bd399936 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302284.469861:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101497216:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 14490us (14791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302284.469871:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 40 00000100:00100000:3.0:1789302284.472564:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302284.472687:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101497600 00000100:00100000:2.0:1789302284.472708:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101497600 00000100:00100000:2.0:1789302284.472788:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 93 00000100:00100000:2.0:1789302284.472818:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:11308:x1876219101497600:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789302284.472917:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.472956:0:9541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39977d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aa5 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.472976:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.473019:0:9541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39977d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aa5 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.473045:0:9541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39977d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aa5 expref: 14 pid: 6532 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302284.473059:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121506816:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302284.473302:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382912240 going to sleep for 11 seconds 00000100:00100000:1.0:1789302284.475794:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121506816:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302284.475818:0:9541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302284.476780:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302284.477107:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101497728 00000100:00100000:0.0:1789302284.477153:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101497728 00010000:00010000:0.0:1789302284.477190:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39977d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aa5 expref: 15 pid: 6532 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302284.477235:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 62 00000100:00100000:0.0:1789302284.477246:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+15:2399:x1876219101497728:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302284.477278:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302284.477286:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39977d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aa5 expref: 15 pid: 6532 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.477299:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39977d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aa5 expref: 15 pid: 6532 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.477321:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd39977d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aa5 expref: 15 pid: 6532 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.477337:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302284.477342:0:10408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.477352:0:10408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.477360:0:10408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.477800:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302284.477915:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:2399:x1876219101497728:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 669us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302284.477924:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 62 00010000:00010000:1.0:1789302284.478189:0:9541:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.478199:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.478371:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.478409:0:9541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd3998fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b07 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.478419:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.478450:0:9541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd3998fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b07 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.478464:0:9541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd3998fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b07 expref: 14 pid: 6531 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302284.478476:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121506944:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302284.478529:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302284.483897:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.483977:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101497856 00000100:00100000:3.0:1789302284.483999:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101497856 00010000:00010000:3.0:1789302284.484039:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd3998fe lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b07 expref: 15 pid: 6531 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302284.484084:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:3.0:1789302284.484094:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+15:2399:x1876219101497856:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302284.484134:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302284.484142:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd3998fe lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b07 expref: 15 pid: 6531 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.484157:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd3998fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b07 expref: 15 pid: 6531 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.484179:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:3.0:1789302284.484186:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.484196:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.484205:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.484233:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302284.484282:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+15:2399:x1876219101497856:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 189us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302284.484290:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 63 00010000:00010000:1.0:1789302284.484726:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd3998fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b07 expref: 14 pid: 6531 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302284.484741:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121506944:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302284.484759:0:9541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.484767:0:9541:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.484773:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789302284.484864:0:9541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1789302284.484964:0:9541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:1.0:1789302284.484991:0:9541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1789302284.485056:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9541:1876219121507072:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789302284.485095:0:9541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302284.485137:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789302284.485267:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121507072 00000100:00100000:3.0:1789302284.485272:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121507072 00000100:00100000:3.0:1789302284.485314:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789302284.485320:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9541:x1876219121507072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789302284.485400:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9541:x1876219121507072:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302284.485407:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789302284.485509:0:9541:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789302284.485514:0:9541:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cc498ad5880, transno 4294967304 00000100:00100000:2.0:1789302284.485531:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9541:1876219121507072:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789302284.485635:0:9541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:2.0:1789302284.485673:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9541:1876219121507200:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789302284.485697:0:9541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302284.485710:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49b111e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302284.485797:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121507200 00000100:00100000:1.0:1789302284.485801:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121507200 00000100:00100000:1.0:1789302284.485831:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789302284.485837:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9541:x1876219121507200:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789302284.485916:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9541:x1876219121507200:12345-0@lo:1000:mdt00_003.0 Request processed in 79us (217us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789302284.485923:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789302284.485948:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9541:1876219121507200:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789302284.485971:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.485979:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.485986:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.485992:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302284.485998:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486006:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486018:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:1.0:1789302284.486027:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302284.486032:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486039:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399944 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486065:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399879 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486071:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399879 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486077:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399879 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486082:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302284.486084:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399879 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486090:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399879 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486097:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:1.0:1789302284.486099:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302284.486102:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399879 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486108:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399879 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486148:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486168:0:9541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aeb expref: 17 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486176:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486196:0:9541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aeb expref: 17 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.486218:0:9541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aeb expref: 17 pid: 10111 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302284.486229:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121507328:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302284.486274:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789302284.491811:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302284.491880:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101497984 00000100:00100000:0.0:1789302284.491889:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101497984 00010000:00010000:0.0:1789302284.491927:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aeb expref: 18 pid: 10111 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302284.491986:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 64 00000100:00100000:0.0:1789302284.491997:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+18:2399:x1876219101497984:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302284.492011:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302284.492018:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aeb expref: 18 pid: 10111 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.492030:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aeb expref: 18 pid: 10111 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.492051:0:13201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:0.0:1789302284.492057:0:13201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.492066:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.492073:0:13201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.492094:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302284.492159:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+18:2399:x1876219101497984:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 163us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302284.492166:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 64 00010000:00010000:2.0:1789302284.492257:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd399895 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5aeb expref: 17 pid: 10111 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302284.492274:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121507328:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302284.492299:0:9541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492308:0:9541:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492315:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492326:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492334:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492341:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492347:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3a00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302284.492351:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492359:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492368:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302284.492370:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302284.492443:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492451:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd39994b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492472:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492479:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492486:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492492:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302284.492495:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492501:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492510:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc488eacb00) 00010000:00010000:2.0:1789302284.492513:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789302284.492515:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302284.492522:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd39993d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302284.492716:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+16:11308:x1876219101497600:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 19918us (20161us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789302284.492725:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 93 00000020:00080000:2.0:1789302284.492729:0:9541:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789302284.492840:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302284.492845:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302284.492860:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789302284.492866:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789302284.495188:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302284.496059:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101498240 00000100:00100000:2.0:1789302284.496070:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101498240 00000100:00100000:2.0:1789302284.496165:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:2.0:1789302284.496176:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+16:11308:x1876219101498240:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789302284.496717:0:6534:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789302284.496899:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:3.0:1789302284.496933:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399952 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.496949:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399952 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.496961:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399952 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.496969:0:6534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399952 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.497016:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399952 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.497024:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399952 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.497050:0:6534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789302284.497164:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+18:11308:x1876219101498240:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 990us (1983us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789302284.497172:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 20 00000020:00080000:3.0:1789302284.497185:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789302284.497327:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302284.497333:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399952 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.497341:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302284.497344:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399952 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.497352:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399952 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.497364:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:0.0:1789302284.497367:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789302284.497383:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399952 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.497390:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399952 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302284.497402:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302284.497404:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302284.497405:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789302284.691022:0:14228:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302284.691030:0:14228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302284.691051:0:14228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789302284.691056:0:14228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789302284.694030:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302284.818672:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302284.818769:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101498496 00000100:00100000:1.0:1789302284.818780:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101498496 00000100:00100000:1.0:1789302284.818839:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 94 00000100:00100000:1.0:1789302284.818850:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+18:11318:x1876219101498496:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302284.818875:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302284.818896:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b23 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.818997:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399960 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.819012:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399960 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.819035:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399960 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302284.819046:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789302284.819160:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b23 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.819175:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399960 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b23 expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.819184:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302284.819187:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789302284.819190:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2800, rc 0) 00000100:00100000:1.0:1789302284.819255:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+20:11318:x1876219101498496:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 406us (589us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789302284.819262:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 94 00000100:00100000:0.0:1789302284.823021:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302284.823106:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101498624 00000100:00100000:1.0:1789302284.823141:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101498624 00000100:00100000:1.0:1789302284.823198:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 95 00000100:00100000:1.0:1789302284.823219:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+20:11318:x1876219101498624:12345-192.168.203.9@tcp:34:lfs.0 00010000:00010000:1.0:1789302284.823295:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39996e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823313:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39996e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823328:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39996e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823354:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399975 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823363:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399975 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823370:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399975 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823456:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39997c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823466:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39997c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823473:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39997c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302284.823525:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39997c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823537:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39996e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823543:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39996e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823550:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39996e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823555:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302284.823559:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39996e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823572:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39996e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823605:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302284.823608:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302284.823614:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39996e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823621:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd39996e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823631:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399975 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823637:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399975 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823642:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399975 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823647:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302284.823649:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399975 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823654:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399975 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823661:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383962700) 00010000:00010000:1.0:1789302284.823664:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302284.823666:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399975 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823680:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399975 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823693:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39997c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823698:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39997c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823703:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39997c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823708:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302284.823722:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39997c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823728:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39997c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.823735:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc383962100) 00010000:00010000:1.0:1789302284.824010:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302284.824017:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39997c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302284.824024:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd39997c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302284.824094:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+20:11318:x1876219101498624:12345-192.168.203.9@tcp:34:lfs.0 Request processed in 887us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302284.824102:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 95 00000100:00100000:1.0:1789302284.884223:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.884289:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101498880 00000100:00100000:3.0:1789302284.884299:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101498880 00000100:00100000:3.0:1789302284.884356:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 96 00000100:00100000:3.0:1789302284.884374:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+20:11321:x1876219101498880:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302284.884393:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302284.884413:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399983 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b2a expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.884480:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39998a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.884493:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39998a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.884505:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39998a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.884532:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399991 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.884540:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.884547:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.884666:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399998 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.884680:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.884687:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302284.884698:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789302284.885085:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39998a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885094:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39998a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885101:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39998a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885107:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302284.885184:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39998a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885193:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39998a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885213:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:3.0:1789302284.885217:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302284.885222:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39998a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885229:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39998a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885243:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885255:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399991 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885262:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399991 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885267:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302284.885270:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399991 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885277:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399991 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885284:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc381fa9300) 00010000:00010000:3.0:1789302284.885286:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302284.885289:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399991 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885295:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399991 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885334:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399983 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b2a expref: 23 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885347:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b2a expref: 22 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.885354:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:3.0:1789302284.886443:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302284.886462:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982a00, rc 0) 00000100:00100000:3.0:1789302284.886595:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+22:11321:x1876219101498880:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 2206us (2380us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789302284.886605:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 96 00000100:00100000:3.0:1789302284.903185:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.903226:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101499008 00000100:00100000:3.0:1789302284.903237:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101499008 00000100:00100000:3.0:1789302284.903287:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 97 00000100:00100000:3.0:1789302284.903297:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+22:11321:x1876219101499008:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:3.0:1789302284.903362:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.903380:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.903391:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.903423:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.903430:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.905359:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.905376:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302284.905381:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.905415:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.905432:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:3.0:1789302284.906171:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302284.906184:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.906193:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302284.906306:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+22:11321:x1876219101499008:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 3005us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302284.906316:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 97 00000100:00100000:3.0:1789302284.908745:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.908777:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101499264 00000100:00100000:3.0:1789302284.908786:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101499264 00000100:00100000:3.0:1789302284.908830:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:3.0:1789302284.908839:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+22:11321:x1876219101499264:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:3.0:1789302284.910276:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+23:11321:x1876219101499264:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 1429us (1531us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789302284.910286:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:0.0:1789302284.991563:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302284.991742:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101499520 00000100:00100000:3.0:1789302284.991752:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101499520 00000100:00100000:3.0:1789302284.991814:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 98 00000100:00100000:3.0:1789302284.991823:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+23:10846:x1876219101499520:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302284.991846:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302284.991878:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd3999ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b31 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.991991:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.992005:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399998 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b2a expref: 24 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.992015:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.992047:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b2a expref: 24 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302284.992062:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399998 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b2a expref: 24 pid: 9541 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302284.992075:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121507456:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302284.993720:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302285.018810:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a28700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121507456:192.168.203.9@tcp:104: 00010000:00010000:0.0:1789302285.018839:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302285.020006:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302285.020099:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101499648 00000100:00100000:1.0:1789302285.020108:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101499648 00010000:00010000:1.0:1789302285.020189:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399998 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b2a expref: 25 pid: 9541 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302285.020236:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 65 00000100:00100000:1.0:1789302285.020246:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+25:2398:x1876219101499648:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302285.020259:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302285.020266:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399998 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b2a expref: 25 pid: 9541 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.020278:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b2a expref: 25 pid: 9541 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.020300:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399998 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b2a expref: 25 pid: 9541 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.020314:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:1.0:1789302285.020319:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.020329:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.020336:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.020356:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302285.020477:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.020490:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302285.020507:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789302285.020628:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd3999ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b31 expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.020644:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b31 expref: 25 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.020651:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:0.0:1789302285.020654:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789302285.020657:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983800, rc 0) 00000100:00100000:1.0:1789302285.020698:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+25:2398:x1876219101499648:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 452us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302285.020706:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 65 00000100:00100000:0.0:1789302285.020905:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+24:10846:x1876219101499520:12345-192.168.203.9@tcp:101:bash.0 Request processed in 29082us (29351us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1789302285.020912:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 98 00000100:00100000:3.0:1789302285.024291:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302285.024389:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101499776 00000100:00100000:2.0:1789302285.024400:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101499776 00000100:00100000:2.0:1789302285.024457:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 99 00000100:00100000:2.0:1789302285.024467:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+24:10846:x1876219101499776:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1789302285.024491:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302285.024511:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd3999c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b38 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.024544:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3999c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.024558:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3999c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.024569:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3999c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.024679:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd3999c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b38 expref: 26 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.024696:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3999c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b38 expref: 25 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.024704:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:2.0:1789302285.024707:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789302285.024717:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348000, rc 0) 00000100:00100000:2.0:1789302285.024770:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+25:10846:x1876219101499776:12345-192.168.203.9@tcp:101:bash.0 Request processed in 304us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302285.024777:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 99 00000100:00100000:0.0:1789302285.036479:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302285.036921:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101500032 00000100:00100000:3.0:1789302285.036932:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101500032 00000100:00100000:3.0:1789302285.037040:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 100 00000100:00100000:3.0:1789302285.037051:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+25:10846:x1876219101500032:12345-192.168.203.9@tcp:36:bash.0 00010000:00010000:3.0:1789302285.037328:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.037346:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.038303:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302285.038373:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:3.0:1789302285.038409:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000103fff8c reply state 0000000087d0667f transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.038421:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.038428:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:3.0:1789302285.038431:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302285.038435:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789302285.038480:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:3.0:1789302285.038594:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+29:10846:x1876219101500032:12345-192.168.203.9@tcp:36:bash.0 Request processed in 1542us (2121us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789302285.038603:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 100 00000020:00080000:3.0:1789302285.038608:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789302285.047542:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302285.047609:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101500160 00000100:00100000:0.0:1789302285.047619:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101500160 00000100:00100000:0.0:1789302285.047676:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 101 00000100:00100000:0.0:1789302285.047686:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+29:10846:x1876219101500160:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1789302285.047708:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302285.047727:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd3999d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b3f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.047783:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd3999d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b3f expref: 30 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.047817:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd3999d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b3f expref: 30 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.047837:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:0.0:1789302285.047840:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302285.047844:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311d600, rc 0) 00000100:00100000:0.0:1789302285.047911:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+30:10846:x1876219101500160:12345-192.168.203.9@tcp:101:bash.0 Request processed in 227us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302285.047918:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 101 00000100:00100000:2.0:1789302285.053357:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302285.053533:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101500288 00000100:00100000:3.0:1789302285.053543:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101500288 00000100:00100000:3.0:1789302285.053608:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 41 00000100:00100000:3.0:1789302285.053617:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:10846:x1876219101500288:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302285.053633:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302285.053653:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c30079e1/0x1ff82925bd3999de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b46 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302285.053677:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa6960b, atime: 0x6aa69609, ctime: 0x6aa6960b, blocks: 0x8 00010000:00010000:3.0:1789302285.053699:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1789302285.053714:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302285.053722:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c30079e1/0x1ff82925bd3999de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b46 expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.053740:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c30079e1/0x1ff82925bd3999de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b46 expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.053752:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982e00, rc 0) 00000100:00100000:3.0:1789302285.053812:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+7:10846:x1876219101500288:12345-192.168.203.9@tcp:101:bash.0 Request processed in 196us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302285.053819:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 41 00000100:00100000:1.0:1789302285.059461:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302285.059563:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101500416 00000100:00100000:2.0:1789302285.059573:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101500416 00002000:00010000:2.0:1789302285.059615:0:8450:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789302285.059620:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4adc8b100 with x1876219101500416 ext(0->18446744073709551615) 00002000:00010000:2.0:1789302285.059631:0:8450:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc4adc8b100. 00000100:00100000:2.0:1789302285.059665:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1 00000100:00100000:2.0:1789302285.059676:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c76ee310-c3b4-4286-aaea-77936c269d98+7:2397:x1876219101500416:12345-192.168.203.9@tcp:10:bash.0 00002000:00010000:2.0:1789302285.060039:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789302285.060043:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789302283 -> 1789302285 00002000:00010000:2.0:1789302285.060046:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789302281 -> 1789302281 00002000:00010000:2.0:1789302285.060048:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789302283 -> 1789302285 00002000:00010000:2.0:1789302285.060050:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789302285.060787:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c76ee310-c3b4-4286-aaea-77936c269d98+8:2397:x1876219101500416:12345-192.168.203.9@tcp:10:bash.0 Request processed in 436us (659us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789302285.060801:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1 00002000:00010000:2.0:1789302285.060806:0:8450:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789302285.060809:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4adc8b100 with x1876219101500416 ext(0->18446744073709551615) 00002000:00010000:2.0:1789302285.060817:0:8450:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc4adc8b100. 00000100:00100000:1.0:1789302285.195691:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302285.195767:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101500544 00000100:00100000:3.0:1789302285.195776:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101500544 00000100:00100000:3.0:1789302285.195831:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 102 00000100:00100000:3.0:1789302285.195841:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+30:11335:x1876219101500544:12345-192.168.203.9@tcp:34:lfs.0 00010000:00010000:3.0:1789302285.195917:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd3999e5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.195934:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd3999e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.195945:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd3999e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.195960:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd3999ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.195967:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd3999ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.195991:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd3999ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196054:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd3999f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196064:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd3999f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196071:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd3999f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302285.196160:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd3999f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196172:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd3999e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196179:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd3999e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196186:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd3999e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196192:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302285.196196:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd3999e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196213:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd3999e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196226:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:3.0:1789302285.196235:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302285.196241:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd3999e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196246:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd3999e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196260:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd3999ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196266:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd3999ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196271:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd3999ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196276:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302285.196278:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd3999ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196283:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd3999ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196290:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc381fa9400) 00010000:00010000:3.0:1789302285.196293:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302285.196295:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd3999ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196301:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd3999ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196314:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd3999f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196326:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd3999f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196332:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd3999f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196336:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983a00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302285.196339:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd3999f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196345:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd3999f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196353:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:3.0:1789302285.196355:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302285.196358:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd3999f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.196364:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd3999f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302285.198622:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+30:11335:x1876219101500544:12345-192.168.203.9@tcp:34:lfs.0 Request processed in 2772us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302285.198636:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 102 00000100:00100000:3.0:1789302285.240830:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302285.240938:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101500800 00000100:00100000:1.0:1789302285.240948:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101500800 00000100:00100000:1.0:1789302285.241008:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 103 00000100:00100000:1.0:1789302285.241019:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+30:11338:x1876219101500800:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302285.241038:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302285.241058:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd3999fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b4d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241411:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a01 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241426:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241438:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241454:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241462:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241468:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241577:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399a0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241587:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399a0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241594:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399a0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302285.241603:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789302285.241671:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241678:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a01 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241685:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241692:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302285.241696:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241703:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a01 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241714:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302285.241717:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302285.241722:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241740:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241754:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241759:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241765:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241769:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3a00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302285.241771:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241776:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241782:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383962100) 00010000:00010000:1.0:1789302285.241784:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302285.241787:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241792:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241827:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd3999fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b4d expref: 33 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241838:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399a0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b4d expref: 32 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.241850:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:1.0:1789302285.241852:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789302285.241855:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3600, rc 0) 00000100:00100000:1.0:1789302285.241966:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+32:11338:x1876219101500800:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 949us (1146us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789302285.241975:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 103 00000100:00100000:1.0:1789302285.246104:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302285.248329:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101500928 00000100:00100000:2.0:1789302285.248342:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101500928 00000100:00100000:2.0:1789302285.248500:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 104 00000100:00100000:2.0:1789302285.248511:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+32:11338:x1876219101500928:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:2.0:1789302285.248572:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.248588:0:9541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b31 expref: 32 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.248596:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.248629:0:9541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b31 expref: 32 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.248643:0:9541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b31 expref: 32 pid: 6531 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302285.248656:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121507584:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302285.248747:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49129f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302285.254512:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302285.254590:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101501184 00000100:00100000:0.0:1789302285.254599:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101501184 00000100:00100000:0.0:1789302285.254654:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:0.0:1789302285.254663:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+33:6166:x1876219101501184:12345-192.168.203.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789302285.254998:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+34:6166:x1876219101501184:12345-192.168.203.9@tcp:35:ldlm_bl.0 Request processed in 334us (493us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789302285.255006:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:3.0:1789302285.255509:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121507584:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302285.255546:0:9541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302285.257633:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302285.257760:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101501312 00000100:00100000:2.0:1789302285.257768:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101501312 00010000:00010000:2.0:1789302285.257812:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b31 expref: 34 pid: 6531 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302285.257850:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 66 00000100:00100000:2.0:1789302285.257860:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+34:2398:x1876219101501312:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302285.257901:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302285.257908:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b31 expref: 34 pid: 6531 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.257920:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b31 expref: 34 pid: 6531 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.257940:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd3999b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b31 expref: 34 pid: 6531 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.257954:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:2.0:1789302285.257958:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.257968:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.257974:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.258002:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302285.258050:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+33:2398:x1876219101501312:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 191us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302285.258058:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 66 00010000:00010000:3.0:1789302285.259245:0:9541:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.259257:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.259309:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.259318:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.259324:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.259330:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302285.259334:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.259342:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.259356:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:3.0:1789302285.259359:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302285.259363:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.259368:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302285.259452:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+32:11338:x1876219101500928:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 10941us (13356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302285.259461:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 104 00000100:00100000:0.0:1789302285.262107:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302285.262396:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101501568 00000100:00100000:3.0:1789302285.262407:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101501568 00000100:00100000:3.0:1789302285.262464:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:3.0:1789302285.262489:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+32:11338:x1876219101501568:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:3.0:1789302285.262777:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+33:11338:x1876219101501568:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 289us (677us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789302285.262784:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:0.0:1789302285.368746:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302285.368850:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101501824 00000100:00100000:2.0:1789302285.368860:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101501824 00000100:00100000:2.0:1789302285.368937:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 105 00000100:00100000:2.0:1789302285.368947:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+33:11349:x1876219101501824:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:2.0:1789302285.368985:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302285.369007:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399a24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b54 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369075:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369090:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369102:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369166:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369174:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369182:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369298:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399a39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369308:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399a39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369315:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399a39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302285.369324:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789302285.369402:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369410:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a2b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369417:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369423:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302285.369427:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369434:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369446:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:2.0:1789302285.369450:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302285.369454:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369461:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369474:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369481:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369487:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369502:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302285.369506:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369513:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369521:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc4adc10800) 00010000:00010000:2.0:1789302285.369523:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302285.369526:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369533:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369575:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399a24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b54 expref: 36 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369589:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399a39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b54 expref: 35 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.369597:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:2.0:1789302285.369599:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302285.369602:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349000, rc 0) 00000100:00100000:2.0:1789302285.369666:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+35:11349:x1876219101501824:12345-192.168.203.9@tcp:101:cat.0 Request processed in 720us (928us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789302285.369673:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 105 00000100:00100000:2.0:1789302285.376406:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302285.376502:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101502080 00000100:00100000:0.0:1789302285.376512:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101502080 00000100:00100000:0.0:1789302285.376565:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:0.0:1789302285.376575:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+35:11349:x1876219101502080:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:0.0:1789302285.376838:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+36:11349:x1876219101502080:12345-192.168.203.9@tcp:35:cat.0 Request processed in 264us (440us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789302285.376856:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:1.0:1789302285.396662:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121508096:0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.396729:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302285.396782:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121508608:0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.396805:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302285.396821:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121509120:0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.396839:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302285.396859:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789302285.396865:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121507968:0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.397000:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302285.397020:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121508480:0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.397047:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302285.397064:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121508992:0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.397083:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302285.397271:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121507968 00000100:00100000:2.0:1789302285.397278:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121507968 00000100:00100000:2.0:1789302285.397325:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789302285.397335:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121507968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302285.397390:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121507968:12345-0@lo:400:kworker.0 Request processed in 58us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302285.397397:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789302285.397441:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121507968:0@lo:400:kworker.0 00000100:00100000:2.0:1789302285.397474:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121508096 00000100:00100000:2.0:1789302285.397479:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121508096 00000100:00100000:2.0:1789302285.397502:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121508480 00000100:00100000:2.0:1789302285.397505:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121508480 00000100:00100000:2.0:1789302285.397526:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121508992 00000100:00100000:2.0:1789302285.397528:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121508992 00000100:00100000:2.0:1789302285.397542:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789302285.397548:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121508096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302285.397581:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121508096:12345-0@lo:400:kworker.0 Request processed in 33us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302285.397586:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789302285.397599:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789302285.397605:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121508480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302285.397629:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121508480:12345-0@lo:400:kworker.0 Request processed in 25us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302285.397635:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789302285.397651:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789302285.397657:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121508992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302285.397678:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121508992:12345-0@lo:400:kworker.0 Request processed in 22us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302285.397696:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00080000:2.0:1789302285.397722:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7ef8000 x1876219121508480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302285.397733:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121508480:0@lo:400:kworker.0 00010000:00080000:2.0:1789302285.397743:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4adc8f480 x1876219121508992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302285.397751:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121508992:0@lo:400:kworker.0 00000100:00100000:2.0:1789302285.397760:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121508096:0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.397966:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121508608 00000100:00100000:1.0:1789302285.397971:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121508608 00000100:00100000:1.0:1789302285.397997:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121509120 00000100:00100000:1.0:1789302285.398000:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121509120 00000100:00100000:1.0:1789302285.398027:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789302285.398033:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121508608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.398069:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121508608:12345-0@lo:400:kworker.0 Request processed in 37us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302285.398074:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789302285.398086:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789302285.398092:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121509120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398228:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121507840:0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398257:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302285.398286:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121508352:0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398304:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302285.398323:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121508864:0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398340:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302285.398360:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789302285.398366:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121507712:0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398388:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302285.398405:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121508224:0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398424:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302285.398438:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121508736:0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398455:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302285.398476:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121509248:0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398496:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302285.398516:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121508736 00000100:00100000:3.0:1789302285.398520:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121508736 00000100:00100000:3.0:1789302285.398538:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121509248 00000100:00100000:3.0:1789302285.398542:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121509248 00000100:00100000:3.0:1789302285.398555:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789302285.398560:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121508736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398600:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121508736:12345-0@lo:400:kworker.0 Request processed in 39us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302285.398606:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789302285.398618:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789302285.398624:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1876219121509248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398647:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1876219121509248:12345-0@lo:400:kworker.0 Request processed in 24us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302285.398653:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789302285.398690:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789302285.398694:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789302285.398696:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302285.398704:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121508224 00000100:00100000:3.0:1789302285.398707:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121508224 00000100:00100000:3.0:1789302285.398726:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789302285.398731:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121508224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398759:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121508224:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302285.398764:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789302285.398779:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121509376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302285.398800:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302285.398828:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121508224:0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398838:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121508736:0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398846:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121509248:0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.398868:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121509376 00000100:00100000:3.0:1789302285.398870:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121509376 00000100:00100000:2.0:1789302285.399037:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121507840 00000100:00100000:2.0:1789302285.399041:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121507840 00000100:00100000:2.0:1789302285.399061:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121508352 00000100:00100000:2.0:1789302285.399063:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121508352 00000100:00100000:2.0:1789302285.399082:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121508864 00000100:00100000:2.0:1789302285.399085:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121508864 00000100:00100000:2.0:1789302285.399100:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789302285.399106:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121507840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.399554:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121509120:12345-0@lo:400:kworker.0 Request processed in 1460us (2711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302285.399562:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789302285.399777:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121508608:0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.399789:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121509120:0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.399834:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789302285.399843:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121508352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.399900:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121508352:12345-0@lo:400:kworker.0 Request processed in 59us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302285.399906:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789302285.399924:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789302285.399931:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121508864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.399957:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121508864:12345-0@lo:400:kworker.0 Request processed in 27us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302285.399962:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:1.0:1789302285.399996:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302285.400021:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121508352:0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.400044:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121508864:0@lo:400:kworker.0 00000100:00100000:2.0:1789302285.400167:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121507840:12345-0@lo:400:kworker.0 Request processed in 1061us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302285.400178:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789302285.400256:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121507712 00000100:00100000:0.0:1789302285.400263:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121507712 00000100:00100000:0.0:1789302285.400299:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789302285.400306:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121507712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302285.400339:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121507712:12345-0@lo:400:kworker.0 Request processed in 34us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302285.400345:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789302285.400630:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789302285.400641:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121509376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302285.400664:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789302285.400697:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121509376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302285.400713:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789302285.401706:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121509376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302285.401718:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121507712:0@lo:400:kworker.0 00000100:00100000:1.0:1789302285.401728:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121507840:0@lo:400:kworker.0 00000100:00100000:3.0:1789302285.414820:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302285.417441:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101502336 00000100:00100000:1.0:1789302285.417456:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101502336 00000100:00100000:1.0:1789302285.417592:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 106 00000100:00100000:1.0:1789302285.417613:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+36:11350:x1876219101502336:12345-192.168.203.9@tcp:36:rm.0 00010000:00010000:1.0:1789302285.417667:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789302285.417693:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d600/0x1ff82925bd3999d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b3f expref: 36 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417716:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399a39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b54 expref: 35 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417727:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399a0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b4d expref: 34 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417739:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd3999c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b38 expref: 33 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417748:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:1.0:1789302285.417753:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302285.417776:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417806:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417816:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417832:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417839:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417846:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417915:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399a55 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417923:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399a55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.417931:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399a55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789302285.418172:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1789302285.418184:0:6532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361461070575ns, next at 362461066992ns, rc = 0 00010000:00010000:1.0:1789302285.418245:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399a5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418254:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399a5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418273:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399a5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418280:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399a5c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418287:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399a5c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418293:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399a5c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418321:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302285.418339:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399a55 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418345:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399a55 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418352:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399a55 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418357:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302285.418361:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399a55 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418369:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399a55 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418376:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:1.0:1789302285.418379:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789302285.418390:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399a55 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418397:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399a55 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418411:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418416:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a47 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418422:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418427:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3a00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302285.418429:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418434:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418442:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302285.418444:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302285.418448:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a47 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418454:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399a47 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302285.418463:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000657fd2d5 reply state 0000000035bc4c03 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418485:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.418492:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383962100) 00010000:00010000:1.0:1789302285.418495:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789302285.418498:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302285.418570:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+34:11350:x1876219101502336:12345-192.168.203.9@tcp:36:rm.0 Request processed in 967us (3757us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789302285.418578:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 106 00010000:00010000:2.0:1789302285.419150:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302285.419158:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399a5c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.419165:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302285.419168:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399a5c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.419175:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399a5c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.419184:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:2.0:1789302285.419187:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789302285.419190:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399a5c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.419196:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399a5c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.419219:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302285.419220:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302285.419222:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302285.512759:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302285.512860:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101502592 00000100:00100000:2.0:1789302285.512870:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101502592 00000100:00100000:2.0:1789302285.512950:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 107 00000100:00100000:2.0:1789302285.512961:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+34:11356:x1876219101502592:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1789302285.512986:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302285.513005:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a63 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b5b expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513160:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513175:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513186:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513197:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513219:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513227:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302285.513716:0:10111:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789302285.513849:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399a78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513859:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399a78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513868:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399a78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513897:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513915:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a6a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513922:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513929:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302285.513934:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513941:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513953:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:2.0:1789302285.513957:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302285.513962:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a6a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513968:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a6a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302285.513981:0:10111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c22f3af reply state 000000009978f260 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513992:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.513998:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383962100) 00010000:00010000:2.0:1789302285.514000:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789302285.514003:0:10111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789302285.514029:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399a63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b5b expref: 37 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.514050:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399a78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b5b expref: 36 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.514057:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc4adc10800) 00010000:00010000:2.0:1789302285.514059:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302285.514061:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348600, rc 0) 00000100:00100000:2.0:1789302285.514687:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+37:11356:x1876219101502592:12345-192.168.203.9@tcp:101:bash.0 Request processed in 1726us (1935us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789302285.514697:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 107 00000100:00100000:2.0:1789302285.522920:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302285.523037:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101502720 00000100:00100000:3.0:1789302285.523047:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101502720 00000100:00100000:3.0:1789302285.523152:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 42 00000100:00100000:3.0:1789302285.523163:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101502720:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302285.523181:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302285.523209:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399a86 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b62 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302285.523235:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302285.523254:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1789302285.523259:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302285.523267:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399a86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b62 expref: 8 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.523285:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399a86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b62 expref: 8 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.523298:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983a00, rc 0) 00000100:00080000:1.0:1789302285.523417:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302285.523556:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101502720:12345-192.168.203.9@tcp:101:bash.0 Request processed in 394us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302285.523563:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 42 00000100:00100000:3.0:1789302285.527417:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302285.529241:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101502848 00000100:00100000:1.0:1789302285.529255:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101502848 00000100:00100000:1.0:1789302285.529374:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 43 00000100:00100000:1.0:1789302285.529385:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+8:11356:x1876219101502848:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1789302285.529403:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302285.529420:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b69 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.529451:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399a86 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b62 expref: 9 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.529460:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302285.530569:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302285.530585:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.530649:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399a86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b62 expref: 9 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.530665:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399a86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b62 expref: 9 pid: 8447 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302285.530680:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc382914700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8446:1876219121509504:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302285.530793:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302285.536754:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302285.537016:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc382914700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8446:1876219121509504:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302285.537048:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 9 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.537068:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3a00, rc 0) 00000100:00100000:1.0:1789302285.537169:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+9:11356:x1876219101502848:12345-192.168.203.9@tcp:101:bash.0 Request processed in 7785us (9762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302285.537177:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 43 00000100:00100000:3.0:1789302285.537685:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101502976 00000100:00100000:3.0:1789302285.537693:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101502976 00010000:00010000:3.0:1789302285.537724:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399a86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b62 expref: 9 pid: 8447 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302285.537782:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 67 00000100:00100000:3.0:1789302285.537791:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+9:2398:x1876219101502976:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302285.537805:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302285.537825:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399a86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b62 expref: 9 pid: 8447 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.537838:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399a86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b62 expref: 9 pid: 8447 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.537860:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399a86 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b62 expref: 9 pid: 8447 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.537872:0:10408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302285.537876:0:10408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302285.537894:0:10408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.537904:0:10408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.537937:0:10408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302285.537950:0:10408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10408:1876219121509632:192.168.203.9@tcp:105: 00000100:00100000:3.0:1789302285.538012:0:10408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957480 going to sleep for 11 seconds 00000100:00100000:3.0:1789302285.552492:0:10408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10408:1876219121509632:192.168.203.9@tcp:105: 00010000:00010000:3.0:1789302285.552518:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302285.552576:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101502976:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 14785us (15829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302285.552587:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 67 00000100:00100000:2.0:1789302285.558232:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302285.558366:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101503232 00000100:00100000:0.0:1789302285.558375:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101503232 00000100:00100000:0.0:1789302285.558433:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:0.0:1789302285.558443:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+37:11356:x1876219101503232:12345-192.168.203.9@tcp:35:bash.0 00000100:00100000:0.0:1789302285.558735:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+38:11356:x1876219101503232:12345-192.168.203.9@tcp:35:bash.0 Request processed in 292us (511us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1789302285.558743:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 25 00010000:00010000:0.0:1789302285.719787:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302285.812487:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302285.812864:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101503360 00000100:00100000:2.0:1789302285.812875:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101503360 00000100:00100000:2.0:1789302285.812943:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 108 00000100:00100000:2.0:1789302285.812954:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+38:11372:x1876219101503360:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302285.812977:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302285.812995:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b70 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.813456:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399a9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.813471:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399a9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.813483:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399a9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302285.813545:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789302285.813549:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302285.813568:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399a9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.813593:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399a94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b70 expref: 40 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.813612:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399a9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b70 expref: 39 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.813621:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:2.0:1789302285.813625:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302285.813628:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348800, rc 0) 00000100:00100000:2.0:1789302285.813696:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+39:11372:x1876219101503360:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 744us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302285.813704:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 108 00000100:00100000:1.0:1789302285.822599:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302285.822853:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101503616 00000100:00100000:2.0:1789302285.822863:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101503616 00000100:00100000:2.0:1789302285.822918:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 109 00000100:00100000:2.0:1789302285.822929:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+39:11372:x1876219101503616:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302285.822949:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302285.822969:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399aa2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b77 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.823074:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399aa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.823102:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.823141:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302285.823155:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789302285.823268:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399aa2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b77 expref: 42 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.823286:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b77 expref: 41 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.823296:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc4adc10800) 00010000:00010000:2.0:1789302285.823299:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302285.823302:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349e00, rc 0) 00000100:00100000:3.0:1789302285.823666:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+41:11372:x1876219101503616:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 736us (1075us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1789302285.823673:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 109 00000100:00100000:3.0:1789302285.829319:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302285.831859:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302285.832023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101504000 00000100:00100000:3.0:1789302285.832033:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101504000 00000100:00100000:3.0:1789302285.832101:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:3.0:1789302285.832151:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+41:2398:x1876219101504000:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302285.832166:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302285.832188:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399aa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b77 expref: 41 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.832217:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc4adc10800) 00010000:00010000:3.0:1789302285.832223:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302285.832274:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+40:2398:x1876219101504000:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 126us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302285.832281:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:2.0:1789302285.833011:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101503872 00000100:00100000:2.0:1789302285.833019:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101503872 00000100:00100000:2.0:1789302285.833061:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 110 00000100:00100000:2.0:1789302285.833069:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+40:11372:x1876219101503872:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302285.833089:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302285.833106:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ab7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b7e expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.833244:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399abe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.833258:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399abe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.833283:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399abe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302285.833296:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789302285.833408:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ab7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b7e expref: 43 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.833424:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399abe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b7e expref: 42 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.833433:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc4adc10800) 00010000:00010000:2.0:1789302285.833436:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789302285.833440:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349000, rc 0) 00000100:00100000:2.0:1789302285.833676:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+42:11372:x1876219101503872:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 607us (4365us total) trans 4294967382 rc 0/0 00000100:00100000:2.0:1789302285.833684:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 110 00000100:00100000:1.0:1789302285.844041:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302285.844215:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101504128 00000100:00100000:3.0:1789302285.844225:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101504128 00000100:00100000:3.0:1789302285.844283:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 44 00000100:00100000:3.0:1789302285.844305:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101504128:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:3.0:1789302285.844350:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.844429:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.844439:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302285.844444:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302285.844449:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.844977:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 8 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.844997:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 8 pid: 8446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302285.845013:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1876219121509760:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302285.845264:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957480 going to sleep for 11 seconds 00000100:00100000:3.0:1789302285.859909:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1876219121509760:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302285.859939:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302285.861375:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302285.862323:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101504256 00000100:00100000:2.0:1789302285.862334:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101504256 00002000:00100000:2.0:1789302285.862387:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8cc4bdbbdf80 x1876219101504256/t0(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:616/0 lens 504/0 e 0 to 0 dl 1789302296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302285.862398:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4bdbbdf80 with x1876219101504256 ext(0->8) 00010000:00010000:2.0:1789302285.862408:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 9 pid: 8446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.862424:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 9 pid: 8446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302285.862451:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cc4bdbbdf80 00000100:00100000:2.0:1789302285.862535:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1 00000100:00100000:2.0:1789302285.862554:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+9:2398:x1876219101504256:12345-192.168.203.9@tcp:4:lfs.0 00000100:00100000:2.0:1789302285.864147:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+11:2398:x1876219101504256:12345-192.168.203.9@tcp:4:lfs.0 Request processed in 1559us (2734us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789302285.864160:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1 00002000:00100000:2.0:1789302285.864170:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8cc4bdbbdf80 x1876219101504256/t4294967303(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:616/0 lens 504/448 e 0 to 0 dl 1789302296 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302285.864181:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4bdbbdf80 with x1876219101504256 ext(0->8) 00010000:00010000:2.0:1789302285.864190:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 11 pid: 8446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.864219:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 11 pid: 8446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302285.864227:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cc4bdbbdf80 00000100:00100000:0.0:1789302285.871737:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302285.871918:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101504384 00000100:00100000:3.0:1789302285.871928:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101504384 00010000:00010000:3.0:1789302285.871981:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 11 pid: 8446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302285.872028:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 68 00000100:00100000:3.0:1789302285.872047:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+11:2397:x1876219101504384:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302285.872062:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789302285.872078:0:13201:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789302285.872081:0:13201:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789302285 00002000:00010000:3.0:1789302285.872084:0:13201:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789302285 00002000:00010000:3.0:1789302285.872086:0:13201:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789302285 00002000:00010000:3.0:1789302285.872089:0:13201:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789302285.872095:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 11 pid: 8446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.872350:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 11 pid: 8446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.872384:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a4471a2/0x1ff82925bd399a8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b69 expref: 11 pid: 8446 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.872402:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302285.872406:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302285.872413:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.872424:0:13201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.872471:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302285.872529:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+10:2397:x1876219101504384:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 492us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302285.872537:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 68 00010000:00010000:0.0:1789302285.872795:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.872805:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.872826:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.872841:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.872850:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.872858:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983a00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302285.872862:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.872872:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.872893:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.872902:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd399acc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302285.872959:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+10:2398:x1876219101504128:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 28655us (28928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302285.872967:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 44 00000100:00100000:0.0:1789302285.885404:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302285.885636:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101504640 00000100:00100000:3.0:1789302285.885647:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101504640 00000100:00100000:3.0:1789302285.885716:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 26 00000100:00100000:3.0:1789302285.885726:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+42:11372:x1876219101504640:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:3.0:1789302285.885790:0:6533:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399abe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b7e expref: 42 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302285.886013:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789302285.886044:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1789302285.887331:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:2.0:1789302285.887407:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.887424:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399a78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b5b expref: 46 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.887433:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.888068:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399a78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b5b expref: 46 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.888087:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399a78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b5b expref: 46 pid: 10111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302285.888102:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6533:1876219121509888:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302285.888739:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484e85d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302285.895891:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302285.897035:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101504768 00000100:00100000:3.0:1789302285.897057:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101504768 00010000:00010000:3.0:1789302285.897160:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399a78 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b5b expref: 47 pid: 10111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302285.897196:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 69 00000100:00100000:3.0:1789302285.897226:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+47:2399:x1876219101504768:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302285.897256:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302285.897264:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399a78 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b5b expref: 47 pid: 10111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.897277:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399a78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b5b expref: 47 pid: 10111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.897316:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc4adc10800) 00010000:00010000:3.0:1789302285.897322:0:10408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.897332:0:10408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.897340:0:10408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302285.897358:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302285.898066:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+47:2399:x1876219101504768:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 839us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302285.898085:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 69 00010000:00010000:2.0:1789302285.899845:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399a78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b5b expref: 46 pid: 10111 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302285.899866:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6533:1876219121509888:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302285.899939:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.899950:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302285.899955:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302285.901760:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:2.0:1789302285.901902:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1789302285.901998:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6533:1876219121510016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789302285.902070:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302285.902106:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484e85f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302285.902838:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121510016 00000100:00100000:3.0:1789302285.902847:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121510016 00000100:00100000:3.0:1789302285.902910:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789302285.902920:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6533:x1876219121510016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789302285.903017:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6533:x1876219121510016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 100us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302285.903025:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789302285.903160:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6533:1876219121510016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789302285.903294:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:1.0:1789302285.903533:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6533:1876219121510144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789302285.903637:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302285.903701:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789302285.904022:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121510144 00000100:00100000:3.0:1789302285.904028:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121510144 00000100:00100000:3.0:1789302285.904264:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789302285.904274:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6533:x1876219121510144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789302285.904490:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6533:x1876219121510144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 217us (852us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789302285.904499:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789302285.904733:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6533:1876219121510144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789302285.904781:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789302285.904818:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.904828:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.904834:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.904841:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302285.904846:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.904854:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.904868:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc4adc10800) 00010000:00010000:1.0:1789302285.904871:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789302285.904876:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302285.904946:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399ad3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789302285.905039:0:6533:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789302285.905092:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789302285.905329:0:6533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361948214745ns, next at 362948212302ns, rc = 0 00000001:00080000:1.0:1789302285.905336:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:1.0:1789302285.905419:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc4adc10800) 00010000:00010000:1.0:1789302285.905423:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789302285.905431:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399abe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b7e expref: 50 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302285.905864:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912b8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+49:11372:x1876219101504640:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 20136us (20466us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789302285.905873:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 26 00000020:00080000:1.0:1789302285.905879:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789302285.908346:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121510272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302285.908426:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302285.908506:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121510272 00000100:00100000:1.0:1789302285.908515:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121510272 00000100:00100000:1.0:1789302285.908567:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789302285.908575:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3645:x1876219121510272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302285.908594:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302285.908629:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3645:x1876219121510272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302285.908636:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789302285.908745:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121510272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302285.909228:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302285.909237:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121510400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302285.909262:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302285.909315:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121510400 00000100:00100000:1.0:1789302285.909320:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121510400 00000100:00100000:1.0:1789302285.909350:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789302285.909356:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121510400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302285.909374:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302285.909400:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121510400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302285.909406:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789302285.909787:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121510400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302285.913589:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302285.913763:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101504896 00000100:00100000:0.0:1789302285.913773:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101504896 00000100:00100000:0.0:1789302285.913829:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 111 00000100:00100000:0.0:1789302285.913839:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+49:11372:x1876219101504896:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1789302285.913863:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302285.913894:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c400/0x1ff82925bd399ada lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b85 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.913947:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c400/0x1ff82925bd399ada lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b85 expref: 50 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.913960:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c400/0x1ff82925bd399ada lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b85 expref: 50 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302285.913976:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:0.0:1789302285.913979:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302285.913983:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311c400, rc 0) 00000100:00100000:0.0:1789302285.914039:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+50:11372:x1876219101504896:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 202us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302285.914046:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 111 00000100:00100000:0.0:1789302285.920005:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302285.920369:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101505152 00000100:00100000:1.0:1789302285.920379:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101505152 00000100:00100000:1.0:1789302285.920482:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 27 00000100:00100000:1.0:1789302285.920492:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+50:11372:x1876219101505152:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:1.0:1789302285.920718:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+51:11372:x1876219101505152:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 227us (720us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789302285.920726:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 27 00000100:00100000:3.0:1789302286.020980:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.021066:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101505280 00000100:00100000:1.0:1789302286.021076:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101505280 00000100:00100000:1.0:1789302286.021163:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 112 00000100:00100000:1.0:1789302286.021178:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+51:11382:x1876219101505280:12345-192.168.203.9@tcp:34:lfs.0 00010000:00010000:1.0:1789302286.021260:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399ae1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021277:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021290:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021303:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399ae8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021315:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021322:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021396:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399aef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021418:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399aef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021425:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399aef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302286.021480:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399aef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021493:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021499:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399ae1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021506:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021512:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302286.021515:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021523:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399ae1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021534:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302286.021537:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302286.021542:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399ae1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021547:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399ae1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021567:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021573:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021579:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021583:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3a00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302286.021586:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021592:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021600:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383962100) 00010000:00010000:1.0:1789302286.021602:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302286.021605:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399ae8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021610:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399ae8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021618:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399aef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021624:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399aef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021630:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399aef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021641:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302286.021644:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399aef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021651:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399aef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021664:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302286.021667:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302286.021670:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399aef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.021675:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399aef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302286.021744:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+51:11382:x1876219101505280:12345-192.168.203.9@tcp:34:lfs.0 Request processed in 566us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302286.021751:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 112 00000100:00080000:3.0:1789302286.023438:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302286.067542:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.070508:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101505536 00000100:00100000:1.0:1789302286.070522:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101505536 00000100:00100000:1.0:1789302286.070590:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 113 00000100:00100000:1.0:1789302286.070600:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+51:11385:x1876219101505536:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302286.070620:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302286.070639:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399af6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b8c expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.070729:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399afd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.070753:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399afd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.070765:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399afd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.070778:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.070786:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.070792:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071395:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399b0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071406:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071414:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302286.071425:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789302286.071500:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399afd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071508:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399afd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071516:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399afd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071529:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3a00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302286.071533:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399afd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071541:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399afd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071553:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302286.071556:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302286.071561:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399afd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071566:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399afd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071582:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071589:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071595:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071600:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302286.071603:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071609:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071626:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383962100) 00010000:00010000:1.0:1789302286.071629:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302286.071632:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071638:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071675:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399af6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b8c expref: 54 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071688:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399b0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b8c expref: 53 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.071695:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302286.071698:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302286.071700:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2c00, rc 0) 00000100:00100000:1.0:1789302286.071768:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+53:11385:x1876219101505536:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1169us (4309us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1789302286.071776:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 113 00000100:00100000:0.0:1789302286.076681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.076893:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101505664 00000100:00100000:2.0:1789302286.076903:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101505664 00000100:00100000:2.0:1789302286.076965:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 114 00000100:00100000:2.0:1789302286.076976:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+53:11385:x1876219101505664:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:2.0:1789302286.077039:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.077056:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.077068:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.077383:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.077393:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.077399:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.077421:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302286.077425:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.077432:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.077443:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:2.0:1789302286.077446:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302286.077450:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.077456:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302286.077590:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+53:11385:x1876219101505664:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 615us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302286.077598:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 114 00000100:00100000:3.0:1789302286.080876:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.081391:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101505920 00000100:00100000:2.0:1789302286.081402:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101505920 00000100:00100000:2.0:1789302286.081516:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 28 00000100:00100000:2.0:1789302286.081526:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+53:11385:x1876219101505920:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:2.0:1789302286.081734:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+54:11385:x1876219101505920:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 209us (870us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789302286.081740:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 28 00000100:00100000:3.0:1789302286.189507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.190261:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101506176 00000100:00100000:1.0:1789302286.190272:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101506176 00000100:00100000:1.0:1789302286.190334:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 115 00000100:00100000:1.0:1789302286.190344:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+54:11395:x1876219101506176:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1789302286.190374:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302286.190377:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789302286.190403:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399a9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b70 expref: 54 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.190437:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302286.190442:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302286.190457:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b20 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b93 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.190659:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.190674:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.190684:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302286.190695:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789302286.190797:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b20 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b93 expref: 56 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.190812:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b93 expref: 55 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.190819:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302286.190822:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302286.190825:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3800, rc 0) 00000100:00100000:1.0:1789302286.190896:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+55:11395:x1876219101506176:12345-192.168.203.9@tcp:101:bash.0 Request processed in 553us (1401us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1789302286.190903:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 115 00000100:00100000:0.0:1789302286.198714:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.198757:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.198855:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101506432 00000100:00100000:2.0:1789302286.198865:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101506432 00000100:00100000:2.0:1789302286.198940:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 8 00000100:00100000:2.0:1789302286.198964:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+55:2397:x1876219101506432:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302286.198979:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302286.199001:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399b27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b93 expref: 55 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.199020:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:2.0:1789302286.199024:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302286.199079:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+54:2397:x1876219101506432:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 118us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302286.199086:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 8 00000100:00100000:1.0:1789302286.199631:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101506304 00000100:00100000:1.0:1789302286.199645:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101506304 00000100:00100000:1.0:1789302286.199688:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 116 00000100:00100000:1.0:1789302286.199696:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+54:11395:x1876219101506304:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1789302286.199714:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302286.199730:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5b9a expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.199760:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399b3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.199773:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.199784:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399b3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.199904:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b9a expref: 56 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.199920:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399b3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b9a expref: 55 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.199927:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302286.199930:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302286.199933:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd3a00, rc 0) 00000100:00100000:1.0:1789302286.199973:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+55:11395:x1876219101506304:12345-192.168.203.9@tcp:101:bash.0 Request processed in 278us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302286.199979:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 116 00000100:00100000:0.0:1789302286.205550:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.205805:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101506688 00000100:00100000:1.0:1789302286.205822:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101506688 00000100:00100000:1.0:1789302286.205889:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 117 00000100:00100000:1.0:1789302286.205899:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+55:11395:x1876219101506688:12345-192.168.203.9@tcp:36:bash.0 00010000:00010000:1.0:1789302286.205947:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302286.205972:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399b0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b8c expref: 55 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.205992:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302286.205996:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302286.206221:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.206235:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.206246:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789302286.206289:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:1.0:1789302286.206310:0:6530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1585cd6 reply state 0000000017c820c3 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.206323:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.206329:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302286.206332:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789302286.206335:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302286.206429:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+57:11395:x1876219101506688:12345-192.168.203.9@tcp:36:bash.0 Request processed in 531us (887us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789302286.206437:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 117 00000020:00080000:1.0:1789302286.206448:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789302286.209986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.210171:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101506816 00000100:00100000:2.0:1789302286.210185:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101506816 00000100:00100000:2.0:1789302286.210278:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 118 00000100:00100000:2.0:1789302286.210291:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+57:11395:x1876219101506816:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1789302286.210322:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302286.210350:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ba1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.210709:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.210727:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.210742:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302286.210781:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789302286.210793:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302286.210821:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.210855:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba1 expref: 59 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.210877:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba1 expref: 58 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.210886:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:2.0:1789302286.210889:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302286.210894:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348e00, rc 0) 00000100:00100000:2.0:1789302286.210971:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+58:11395:x1876219101506816:12345-192.168.203.9@tcp:101:bash.0 Request processed in 682us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302286.210979:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 118 00000100:00100000:0.0:1789302286.213989:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.214172:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101507072 00000100:00100000:1.0:1789302286.214186:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101507072 00000100:00100000:1.0:1789302286.214268:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00100000:1.0:1789302286.214279:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+58:11395:x1876219101507072:12345-192.168.203.9@tcp:35:bash.0 00000100:00100000:1.0:1789302286.214680:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+59:11395:x1876219101507072:12345-192.168.203.9@tcp:35:bash.0 Request processed in 399us (703us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789302286.214690:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00100000:0.0:1789302286.300274:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.300526:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101507200 00000100:00100000:2.0:1789302286.300540:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101507200 00000100:00100000:2.0:1789302286.300622:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 119 00000100:00100000:2.0:1789302286.300635:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+59:11401:x1876219101507200:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302286.300666:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302286.300694:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ba8 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.300786:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399b5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.300805:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.300846:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302286.301159:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789302286.301165:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302286.301193:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.301235:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399b58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba8 expref: 61 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.301259:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399b5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba8 expref: 60 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.301268:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:2.0:1789302286.301272:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302286.301277:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348800, rc 0) 00000100:00100000:2.0:1789302286.301367:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+60:11401:x1876219101507200:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 734us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302286.301375:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 119 00000100:00100000:0.0:1789302286.304697:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302286.304794:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101507328 00000100:00100000:3.0:1789302286.304808:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101507328 00000100:00100000:3.0:1789302286.304897:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 120 00000100:00100000:3.0:1789302286.304910:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+60:11401:x1876219101507328:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302286.304938:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302286.304965:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5baf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305048:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399b6d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305067:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399b6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305083:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399b6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305096:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399b74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305105:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399b74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305171:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399b74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305283:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305318:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305326:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302286.305674:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789302286.305682:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302286.305712:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305728:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305739:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399b6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305746:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399b6d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305755:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399b6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305761:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302286.305766:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399b6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305775:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399b6d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305790:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:3.0:1789302286.305794:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302286.305809:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399b6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305816:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399b6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305836:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399b74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305842:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399b74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305847:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399b74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305853:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302286.305856:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399b74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305861:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399b74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305869:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383962100) 00010000:00010000:3.0:1789302286.305872:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302286.305933:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399b74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305941:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399b74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.305975:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5baf expref: 62 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.306003:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5baf expref: 61 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.306011:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302286.306014:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302286.306017:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983a00, rc 0) 00000100:00100000:3.0:1789302286.306093:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+61:11401:x1876219101507328:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1185us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302286.306101:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 120 00000100:00100000:0.0:1789302286.312941:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.313006:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.313167:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101507584 00000100:00100000:1.0:1789302286.313182:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101507584 00000100:00100000:1.0:1789302286.313269:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 121 00000100:00100000:1.0:1789302286.313282:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+61:11401:x1876219101507584:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302286.313309:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302286.313339:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399b82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5bb6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.313503:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.313523:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba1 expref: 62 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.313533:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5baf expref: 62 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.313544:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.313588:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5baf expref: 62 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.313624:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5baf expref: 62 pid: 6532 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302286.313642:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121510528:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302286.313786:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba1 expref: 62 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.313797:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba1 expref: 62 pid: 6531 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302286.313808:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121510656:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302286.313833:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302286.314143:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101507712 00000100:00100000:3.0:1789302286.314151:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101507712 00010000:00010000:3.0:1789302286.314181:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5baf expref: 63 pid: 6532 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302286.314234:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 70 00000100:00100000:3.0:1789302286.314244:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+63:2399:x1876219101507712:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302286.314255:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302286.314262:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5baf expref: 63 pid: 6532 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.314276:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5baf expref: 63 pid: 6532 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.314300:0:13201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302286.314305:0:13201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.314325:0:13201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.314332:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302286.314368:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+63:2399:x1876219101507712:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 125us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302286.314377:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 70 00000100:00100000:0.0:1789302286.320723:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.320809:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101507840 00000100:00100000:2.0:1789302286.320823:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101507840 00010000:00010000:2.0:1789302286.320892:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba1 expref: 63 pid: 6531 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302286.320945:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 71 00000100:00100000:2.0:1789302286.320958:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+63:2398:x1876219101507840:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302286.320997:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302286.321005:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba1 expref: 63 pid: 6531 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.321022:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba1 expref: 63 pid: 6531 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.321051:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:2.0:1789302286.321057:0:10408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.321068:0:10408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.321077:0:10408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.321524:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302286.321610:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+63:2398:x1876219101507840:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 652us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302286.321621:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 71 00010000:00010000:1.0:1789302286.322954:0:6531:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.9@tcp) returned -22 from blocking AST (req@000000004b91886d x1876219121510528) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5baf expref: 62 pid: 6532 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.322983:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399b7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5baf expref: 62 pid: 6532 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302286.323006:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121510528:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302286.323026:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399b51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba1 expref: 61 pid: 6531 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302286.323038:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121510656:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302286.323067:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302286.323098:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.323156:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.323163:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302286.323204:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789302286.323615:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399b82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bb6 expref: 62 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.323639:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bb6 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.323648:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302286.323650:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789302286.323653:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2400, rc 0) 00000100:00100000:1.0:1789302286.323737:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+61:11401:x1876219101507584:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 10456us (10809us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789302286.323747:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 121 00000100:00100000:0.0:1789302286.327653:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302286.327763:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101508096 00000100:00100000:3.0:1789302286.327777:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101508096 00000100:00100000:3.0:1789302286.327865:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 9 00000100:00100000:3.0:1789302286.327878:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+61:11401:x1876219101508096:12345-192.168.203.9@tcp:103:lfs.0 00010000:00010000:3.0:1789302286.327910:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302286.327944:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c400/0x1ff82925bd399ada lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b85 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.327969:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302286.327976:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302286.328053:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+60:11401:x1876219101508096:12345-192.168.203.9@tcp:103:lfs.0 Request processed in 177us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302286.328062:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 9 00000100:00100000:0.0:1789302286.338267:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.338382:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101508224 00000100:00100000:2.0:1789302286.338397:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101508224 00000100:00100000:2.0:1789302286.338475:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 122 00000100:00100000:2.0:1789302286.338488:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+60:11401:x1876219101508224:12345-192.168.203.9@tcp:58:lfs.0 00010000:00010000:2.0:1789302286.338637:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.338660:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.338694:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302286.338844:0:10111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789302286.338963:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+60:11401:x1876219101508224:12345-192.168.203.9@tcp:58:lfs.0 Request processed in 475us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302286.338972:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 122 00000100:00100000:2.0:1789302286.342749:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302286.343017:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101508352 00000100:00100000:3.0:1789302286.343030:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101508352 00000100:00100000:3.0:1789302286.343102:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 123 00000100:00100000:3.0:1789302286.343167:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+60:11401:x1876219101508352:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302286.343205:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302286.343234:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5bbd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.343328:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.343341:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b9e lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bbd expref: 61 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.343366:0:6532:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.343382:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b9e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bbd expref: 61 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.343412:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302286.343416:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302286.343421:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b9e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bbd expref: 61 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.343430:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983200, rc 0) 00000100:00100000:3.0:1789302286.343513:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+61:11401:x1876219101508352:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 349us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302286.343521:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 123 00000100:00100000:1.0:1789302286.420917:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302286.420950:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121510784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302286.421054:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302286.421639:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121510784 00000100:00100000:0.0:1789302286.421651:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121510784 00000100:00100000:0.0:1789302286.421715:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789302286.421726:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121510784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302286.421770:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789302286.421837:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121510784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302286.421846:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789302286.421912:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383b76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121510784:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789302286.548528:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302286.548541:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789302286.548616:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789302286.548627:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789302286.548806:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121510912:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789302286.549208:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302286.562276:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.562422:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121510912:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789302286.563185:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101508480 00000100:00100000:3.0:1789302286.563207:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101508480 00000100:00100000:3.0:1789302286.563283:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 124 00000100:00100000:3.0:1789302286.563294:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+61:11402:x1876219101508480:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789302286.563336:0:6531:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789302286.563504:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+61:11402:x1876219101508480:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 210us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302286.563513:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 124 00000100:00100000:0.0:1789302286.571688:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.571794:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101508608 00000100:00100000:2.0:1789302286.571807:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101508608 00000100:00100000:2.0:1789302286.571973:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 125 00000100:00100000:2.0:1789302286.571985:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+61:11402:x1876219101508608:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789302286.572087:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399ba5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572298:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572316:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572338:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572346:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572354:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572403:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572415:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572423:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302286.572484:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789302286.572490:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302286.572506:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572520:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572527:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399ba5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572534:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572541:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302286.572545:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572554:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399ba5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.572568:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:2.0:1789302286.572577:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302286.572584:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399ba5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.574738:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399ba5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.574778:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.574786:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.574794:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.574801:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302286.574806:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.574815:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.574835:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8cc4adc10c00) 00010000:00010000:2.0:1789302286.574838:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302286.574844:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.574850:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.574874:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.576097:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.576130:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.576138:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302286.576143:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.576153:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.576170:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:2.0:1789302286.576173:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302286.576179:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bb3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.576185:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302286.576338:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+61:11402:x1876219101508608:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 4347us (4656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302286.576349:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 125 00000100:00100000:0.0:1789302286.585916:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.586171:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101508864 00000100:00100000:1.0:1789302286.586184:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101508864 00000100:00100000:1.0:1789302286.586270:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 126 00000100:00100000:1.0:1789302286.586282:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+61:11402:x1876219101508864:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302286.586314:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302286.586341:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399bba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5bc4 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.586490:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399bc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.586511:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.586527:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302286.586543:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789302286.587166:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.587182:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.587191:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.587232:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302286.587237:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.587247:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.587264:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302286.587267:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789302286.587273:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399bc1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.587280:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399bc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.587336:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399bba lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bc4 expref: 63 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.587348:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:1.0:1789302286.587351:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302286.587355:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399bba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bc4 expref: 63 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.587366:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4addd2c00, rc 0) 00000100:00100000:1.0:1789302286.587903:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+62:11402:x1876219101508864:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1620us (2008us total) trans 4294967400 rc 301/301 00000100:00100000:1.0:1789302286.587914:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 126 00000100:00100000:2.0:1789302286.601202:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.601259:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101508992 00000100:00100000:1.0:1789302286.601296:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101508992 00000100:00100000:1.0:1789302286.601365:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 127 00000100:00100000:1.0:1789302286.601377:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+62:11402:x1876219101508992:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789302286.601424:0:9541:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789302286.601578:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+62:11402:x1876219101508992:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 202us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302286.601587:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 127 00000100:00100000:0.0:1789302286.620891:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.621034:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101509248 00000100:00100000:2.0:1789302286.621050:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101509248 00000100:00100000:2.0:1789302286.621176:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 128 00000100:00100000:2.0:1789302286.621190:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+62:11402:x1876219101509248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302286.621300:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302286.621304:0:10111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789302286.621343:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399b5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ba8 expref: 62 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.621365:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:2.0:1789302286.621371:0:10111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302286.621387:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bcf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5bcb expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302286.626850:0:10111:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789302286.627108:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.630239:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.630260:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.630415:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399bcf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bcb expref: 64 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.630443:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bcb expref: 63 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.630454:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc4adc10c00) 00010000:00010000:2.0:1789302286.630458:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302286.630483:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348000, rc 0) 00000100:00100000:2.0:1789302286.630611:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+63:11402:x1876219101509248:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 9423us (9736us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789302286.630623:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 128 00000100:00100000:0.0:1789302286.641187:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.641297:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101509504 00000100:00100000:1.0:1789302286.641311:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101509504 00000100:00100000:1.0:1789302286.641389:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 129 00000100:00100000:1.0:1789302286.641402:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+63:11402:x1876219101509504:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302286.641479:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302286.641526:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399bd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bcb expref: 63 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.641550:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc4adc10c00) 00010000:00010000:1.0:1789302286.641563:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302286.641592:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399be4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.641610:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399be4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.641622:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399be4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.643905:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399beb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xae911da2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.643946:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399beb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xae911da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.643960:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399beb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xae911da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644054:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399be4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644062:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399be4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644071:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399be4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644078:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302286.644083:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399be4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644091:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399be4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644102:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:1.0:1789302286.644105:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302286.644159:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399be4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644166:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2c00/0x1ff82925bd399be4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644182:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399beb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xae911da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644210:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399beb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xae911da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644216:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399beb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xae911da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644220:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302286.644223:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399beb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xae911da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644229:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399beb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xae911da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644238:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xae911da2 (ffff8cc383960500) 00010000:00010000:1.0:1789302286.644241:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302286.644244:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399beb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xae911da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.644250:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3600/0x1ff82925bd399beb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xae911da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302286.644347:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+62:11402:x1876219101509504:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 2943us (3171us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302286.644356:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 129 00000100:00100000:3.0:1789302286.650300:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.650487:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101509632 00000100:00100000:1.0:1789302286.650500:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101509632 00000100:00100000:1.0:1789302286.650781:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 130 00000100:00100000:1.0:1789302286.650792:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+62:11402:x1876219101509632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302286.650811:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302286.650845:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399bf2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5bd2 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.650879:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd399bf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.650897:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd399bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.650909:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd399bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.651021:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3800/0x1ff82925bd399bf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd2 expref: 64 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.651039:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd399bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd2 expref: 63 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.651047:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302286.651050:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302286.651053:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f400, rc 0) 00000100:00100000:1.0:1789302286.651145:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+63:11402:x1876219101509632:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 356us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302286.651152:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 130 00000100:00100000:0.0:1789302286.658404:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.658722:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101509888 00000100:00100000:2.0:1789302286.658734:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101509888 00000100:00100000:2.0:1789302286.658796:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 131 00000100:00100000:2.0:1789302286.658806:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+63:11402:x1876219101509888:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789302286.658896:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.658913:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.658926:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302286.659312:0:10111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1789302286.659336:0:10111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362702211507ns, next at 363702208237ns, rc = 0 00000004:00010000:2.0:1789302286.659390:0:10111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000026cba7f reply state 000000005255c007 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.659404:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.659411:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302286.659414:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789302286.659418:0:10111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302286.659508:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+65:11402:x1876219101509888:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 702us (1113us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789302286.659526:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 131 00000100:00100000:0.0:1789302286.661838:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.661912:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101510016 00000100:00100000:1.0:1789302286.661921:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101510016 00000100:00100000:1.0:1789302286.662181:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 132 00000100:00100000:1.0:1789302286.662203:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+65:11402:x1876219101510016:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302286.662227:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302286.662272:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399c07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5bd9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.662330:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399c07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd9 expref: 66 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.662344:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399c07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd9 expref: 66 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.662361:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302286.662364:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302286.662367:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aa400, rc 0) 00000100:00100000:1.0:1789302286.662419:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+66:11402:x1876219101510016:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 228us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302286.666446:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 132 00000100:00100000:0.0:1789302286.674762:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.677020:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101510144 00000100:00100000:2.0:1789302286.677033:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101510144 00000100:00100000:2.0:1789302286.677141:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 45 00000100:00100000:2.0:1789302286.677154:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101510144:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789302286.677382:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+9:2398:x1876219101510144:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 230us (2628us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789302286.677389:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 45 00000100:00080000:3.0:1789302286.680503:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302286.680787:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.680889:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101510272 00000100:00100000:1.0:1789302286.680899:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101510272 00000100:00100000:1.0:1789302286.680956:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 388 00000100:00100000:1.0:1789302286.680966:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101510272:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302286.681046:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101510272:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302286.681054:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 388 00000100:00100000:0.0:1789302286.691165:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.691244:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302286.691741:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101510400 00000100:00100000:3.0:1789302286.691756:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101510400 00000100:00100000:3.0:1789302286.691853:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101510656 00000100:00100000:3.0:1789302286.691857:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101510656 00000100:00100000:3.0:1789302286.691904:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 310 00000100:00100000:3.0:1789302286.691917:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101510400:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302286.692036:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101510400:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 121us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302286.692044:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 310 00000100:00100000:3.0:1789302286.692066:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 311 00000100:00100000:3.0:1789302286.692078:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101510656:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302286.692217:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101510656:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 138us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302286.692224:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 311 00000100:00080000:1.0:1789302286.692700:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302286.692707:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302286.702743:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302286.702795:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.702866:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101511040 00000100:00100000:2.0:1789302286.702882:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101511040 00000100:00100000:3.0:1789302286.702930:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.702981:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:2.0:1789302286.702995:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+66:11402:x1876219101511040:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789302286.703255:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+67:11402:x1876219101511040:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 262us (526us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789302286.703262:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:2.0:1789302286.703315:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101510784 00000100:00100000:2.0:1789302286.703320:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101510784 00000100:00100000:2.0:1789302286.703358:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 312 00000100:00100000:2.0:1789302286.703366:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101510784:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302286.703393:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101510784:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302286.703398:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 312 00000100:00100000:0.0:1789302286.704014:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101510528 00000100:00100000:0.0:1789302286.704025:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101510528 00000100:00100000:0.0:1789302286.704088:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 142 00000100:00100000:0.0:1789302286.704099:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+9:2399:x1876219101510528:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302286.704209:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+9:2399:x1876219101510528:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 111us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302286.704216:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 142 00000100:00100000:3.0:1789302286.707153:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.707612:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101511296 00000100:00100000:0.0:1789302286.707626:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101511296 00000100:00100000:0.0:1789302286.707712:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 133 00000100:00100000:0.0:1789302286.707723:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+67:11402:x1876219101511296:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789302286.707866:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+67:11402:x1876219101511296:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 144us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302286.707886:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 133 00000100:00080000:1.0:1789302286.708796:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302286.719791:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.720070:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101511424 00000100:00100000:0.0:1789302286.720083:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101511424 00000100:00100000:0.0:1789302286.720276:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 134 00000100:00100000:0.0:1789302286.720289:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+67:11402:x1876219101511424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302286.720319:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302286.720351:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399c0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5be0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.720450:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399c15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.720468:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399c15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.720497:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399c15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302286.720572:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789302286.720597:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399c15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.720630:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399c0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be0 expref: 69 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.720653:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399c15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be0 expref: 68 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.720661:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:0.0:1789302286.720664:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789302286.720668:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311c200, rc 0) 00000100:00100000:0.0:1789302286.720751:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+68:11402:x1876219101511424:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 465us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302286.720760:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 134 00000100:00100000:3.0:1789302286.725061:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.725190:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101511552 00000100:00100000:1.0:1789302286.725214:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101511552 00000100:00100000:1.0:1789302286.725289:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 46 00000100:00100000:1.0:1789302286.725316:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+9:2396:x1876219101511552:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302286.725335:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302286.725361:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6689c1b/0x1ff82925bd399c1c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5be7 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789302286.725387:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6960e, blocks: 0x0 00010000:00010000:1.0:1789302286.725406:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:1.0:1789302286.725411:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302286.725420:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6689c1b/0x1ff82925bd399c1c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be7 expref: 10 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.725438:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6689c1b/0x1ff82925bd399c1c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be7 expref: 10 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.725451:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aba00, rc 0) 00000100:00100000:1.0:1789302286.725521:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+10:2396:x1876219101511552:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 207us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302286.725527:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 46 00000100:00100000:1.0:1789302286.731933:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302286.737336:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101511808 00000100:00100000:3.0:1789302286.737352:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101511808 00000100:00100000:3.0:1789302286.737431:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 135 00000100:00100000:3.0:1789302286.737441:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+68:11402:x1876219101511808:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789302286.737563:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+68:11402:x1876219101511808:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 122us (5639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302286.737570:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 135 00010000:00010000:0.0:1789302286.740551:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302286.742580:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.742758:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101511936 00000100:00100000:0.0:1789302286.742772:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101511936 00000100:00100000:0.0:1789302286.742846:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 47 00000100:00100000:0.0:1789302286.742858:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+10:11402:x1876219101511936:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302286.742893:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302286.742919:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5bee expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.743077:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6689c1b/0x1ff82925bd399c1c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be7 expref: 11 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.743088:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302286.743093:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302286.743099:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 11 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.743204:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6689c1b/0x1ff82925bd399c1c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be7 expref: 11 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.743223:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6689c1b/0x1ff82925bd399c1c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be7 expref: 11 pid: 8446 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302286.743242:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383b75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1876219121511040:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302286.743771:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302286.756210:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383b75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1876219121511040:192.168.203.9@tcp:104: 00010000:00010000:0.0:1789302286.756283:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 11 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.756311:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311ca00, rc 0) 00000100:00100000:0.0:1789302286.756388:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+11:11402:x1876219101511936:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 13530us (13821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302286.756398:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 47 00000100:00100000:3.0:1789302286.756866:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.757216:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101512064 00000100:00100000:0.0:1789302286.757228:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101512064 00010000:00010000:0.0:1789302286.757290:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6689c1b/0x1ff82925bd399c1c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be7 expref: 11 pid: 8446 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302286.757334:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:0.0:1789302286.757346:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+11:2397:x1876219101512064:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302286.757365:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302286.757397:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6689c1b/0x1ff82925bd399c1c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be7 expref: 11 pid: 8446 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.757412:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6689c1b/0x1ff82925bd399c1c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be7 expref: 11 pid: 8446 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.757443:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6689c1b/0x1ff82925bd399c1c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be7 expref: 11 pid: 8446 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.757461:0:6515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302286.757466:0:6515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302286.757475:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 10 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.757486:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 10 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.757527:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 10 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302286.757558:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383b75880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6515:1876219121511168:192.168.203.9@tcp:105: 00000100:00100000:0.0:1789302286.757691:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302286.765594:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.765905:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383b75880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6515:1876219121511168:192.168.203.9@tcp:105: 00010000:00010000:0.0:1789302286.765935:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302286.766086:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+10:2397:x1876219101512064:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 8740us (9219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302286.766100:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:2.0:1789302286.767477:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101512192 00000100:00100000:2.0:1789302286.767493:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101512192 00002000:00100000:2.0:1789302286.767566:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8cc48838f800 x1876219101512192/t0(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:617/0 lens 504/0 e 0 to 0 dl 1789302297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302286.767578:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc48838f800 with x1876219101512192 ext(0->12) 00002000:00010000:2.0:1789302286.767584:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc48838f800 00000100:00100000:2.0:1789302286.767609:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2 00000100:00100000:2.0:1789302286.767618:0:8450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c76ee310-c3b4-4286-aaea-77936c269d98+10:2398:x1876219101512192:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789302286.773175:0:8450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c76ee310-c3b4-4286-aaea-77936c269d98+12:2398:x1876219101512192:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 4477us (6517us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789302286.773304:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2 00002000:00100000:2.0:1789302286.773319:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8cc48838f800 x1876219101512192/t4294967309(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:617/0 lens 504/448 e 0 to 0 dl 1789302297 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302286.773329:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc48838f800 with x1876219101512192 ext(0->12) 00002000:00010000:2.0:1789302286.773335:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc48838f800 00000100:00100000:3.0:1789302286.783484:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.785578:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101512320 00000100:00100000:2.0:1789302286.785594:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101512320 00000100:00100000:2.0:1789302286.785677:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 136 00000100:00100000:2.0:1789302286.785688:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+68:11402:x1876219101512320:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789302286.796600:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:1.0:1789302286.796617:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1789302286.796653:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789302286.796684:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cc383bb7240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789302286.796689:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc4bd8fbc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cc383bb7c00 00000020:00080000:1.0:1789302286.796692:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc4bd8fbe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cc48aba0e00 00000004:00080000:1.0:1789302286.796733:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789302286.796777:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cc49129fe40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789302286.796780:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc484e05700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cc382912240 00000020:00080000:1.0:1789302286.796784:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc484e05900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cc48aba0c00 00000100:00100000:2.0:1789302286.797068:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+22:11402:x1876219101512320:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 11377us (13596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302286.797079:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 136 00000100:00100000:3.0:1789302286.797322:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302286.797348:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121511296:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789302286.797396:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797411:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302286.797429:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302286.797430:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797441:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302286.797445:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797454:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797469:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cc383963000) 00010000:00010000:0.0:1789302286.797472:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302286.797476:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797496:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399928 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797521:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797528:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797534:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797539:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302286.797542:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797548:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797556:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cc381fa9f00) 00010000:00010000:0.0:1789302286.797559:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302286.797561:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797567:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd3999d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789302286.797571:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:0.0:1789302286.797583:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797588:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797599:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797605:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302286.797608:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797615:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797627:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383962100) 00010000:00010000:0.0:1789302286.797630:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1789302286.797631:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1789302286.797633:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797640:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2200/0x1ff82925bd399a4e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797657:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797664:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302286.797668:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121511424:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789302286.797683:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797690:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302286.797694:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302286.797712:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302286.797714:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797725:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc383962100) 00010000:00010000:0.0:1789302286.797728:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302286.797730:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797736:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399a71 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797750:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797758:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797763:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797890:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302286.797894:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797899:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797907:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:0.0:1789302286.797909:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302286.797911:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797925:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3e00/0x1ff82925bd399b43 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797936:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797942:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797947:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797951:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302286.797954:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797959:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797967:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:0.0:1789302286.797969:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789302286.797972:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.797978:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302286.802351:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302286.802380:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121511552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789302286.802462:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302286.802658:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121511296 00000100:00100000:2.0:1789302286.802670:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121511296 00000100:00100000:2.0:1789302286.802752:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121511424 00000100:00100000:2.0:1789302286.802756:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121511424 00000100:00100000:2.0:1789302286.802784:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789302286.802813:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3647:x1876219121511296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789302286.802855:0:8446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1789302286.802899:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa6960d, atime: 0x6aa6960d, ctime: 0x6aa6960d, blocks: 0x8 00010000:00010000:2.0:1789302286.802908:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd399c2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302286.803346:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789302286.803359:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876219121511424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789302286.803377:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1789302286.803395:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.803419:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c30079e1/0x1ff82925bd3999de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b46 expref: 11 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.803430:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789302286.803436:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302286.803441:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.803485:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c30079e1/0x1ff82925bd3999de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b46 expref: 11 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.803502:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c30079e1/0x1ff82925bd3999de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b46 expref: 11 pid: 8445 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302286.803517:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121511680:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302286.803621:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7300 going to sleep for 11 seconds 00010000:00010000:2.0:1789302286.803711:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1789302286.803715:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302286.803722:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd399c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.803742:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd399c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.803754:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd399c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.803762:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd399c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.803780:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789302286.804004:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3647:x1876219121511296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1193us (6576us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789302286.804014:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1789302286.804350:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302286.804359:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd399c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.804369:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348e00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302286.804374:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd399c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.804386:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd399c2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.804408:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd399c2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.804416:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd399c2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.804443:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302286.804446:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302286.804448:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789302286.814235:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc4b7ef9c00/2, rc 0, transno 4294967305 00000100:00100000:0.0:1789302286.814260:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121511296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789302286.815372:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000001:00080000:3.0:1789302286.817061:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1789302286.817095:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1789302286.819740:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.819770:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101512576 00000100:00100000:0.0:1789302286.819834:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101512576 00000100:00100000:1.0:1789302286.819867:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121511680:192.168.203.9@tcp:104: 00010000:00010000:0.0:1789302286.819872:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c30079e1/0x1ff82925bd3999de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b46 expref: 12 pid: 8445 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302286.819906:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 73 00000100:00100000:0.0:1789302286.819915:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+12:2398:x1876219101512576:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302286.819938:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.819939:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302286.819948:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c30079e1/0x1ff82925bd3999de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b46 expref: 12 pid: 8445 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.819965:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c30079e1/0x1ff82925bd3999de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b46 expref: 12 pid: 8445 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.819986:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c30079e1/0x1ff82925bd3999de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b46 expref: 12 pid: 8445 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.820001:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302286.820005:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302286.820011:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.820021:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.820045:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302286.820132:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302286.820267:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+11:2398:x1876219101512576:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 351us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302286.820275:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 73 00010000:00010000:1.0:1789302286.820543:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.820555:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.820563:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.820584:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789302286.820831:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1876219121511424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17475us (23120us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789302286.820839:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1789302286.820860:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302286.820867:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.820875:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aaa00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302286.820879:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.820887:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.820900:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.820906:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd399c31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.820923:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302286.820924:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302286.820926:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302286.826424:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121511552 00000100:00100000:2.0:1789302286.826448:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121511552 00000100:00100000:2.0:1789302286.826554:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101512448 00000100:00100000:2.0:1789302286.826575:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101512448 00000100:00100000:2.0:1789302286.826603:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789302286.826615:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1876219121511552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789302286.827010:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 51 00002000:00010000:2.0:1789302286.827019:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789302286.827026:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789302286 00002000:00010000:2.0:1789302286.827029:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789302286.827033:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789302286 -> 1789302286 00002000:00010000:2.0:1789302286.827036:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789302286.827041:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+11:2396:x1876219101512448:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1789302286.827383:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc48838c700/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789302286.827391:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121511424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789302286.828872:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3645:x1876219121511552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2250us (26400us total) trans 4294967311 rc 0/0 00000004:00080000:3.0:1789302286.828915:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc48838dc00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789302286.828985:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121511552:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789302286.834209:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1789302286.834227:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1789302286.835052:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2396:x1876219101512448:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 8013us (19669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302286.835069:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 51 00000100:00100000:2.0:1789302286.839258:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302286.841407:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.842391:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101512832 00000100:00100000:1.0:1789302286.842408:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101512832 00000100:00100000:1.0:1789302286.842663:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 137 00000100:00100000:1.0:1789302286.842677:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+16:11402:x1876219101512832:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302286.842762:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302286.842797:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399c15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5be0 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.842820:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302286.842827:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302286.842865:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.842897:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.842908:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302286.843064:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e46b1a2d reply state 000000004ef39ee5 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.843078:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.843100:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302286.843103:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789302286.843106:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302286.843276:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+17:11402:x1876219101512832:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 602us (1882us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1789302286.843285:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 137 00000100:00100000:3.0:1789302286.846379:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.846626:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101512960 00000100:00100000:0.0:1789302286.846638:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101512960 00000100:00100000:0.0:1789302286.846710:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:0.0:1789302286.846722:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101512960:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789302286.846938:0:8852:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789302286.846942:0:8852:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789302286 -> 1789302286 00002000:00010000:0.0:1789302286.846945:0:8852:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789302285 00002000:00010000:0.0:1789302286.846947:0:8852:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789302286 -> 1789302286 00002000:00010000:0.0:1789302286.846949:0:8852:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789302286.847030:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101512960:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 310us (667us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789302286.847039:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:0.0:1789302286.855050:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.855168:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101513216 00000100:00100000:2.0:1789302286.855181:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101513216 00000100:00100000:2.0:1789302286.855270:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 138 00000100:00100000:2.0:1789302286.855284:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+17:11402:x1876219101513216:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789302286.855380:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.855402:0:10111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd399bf9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd2 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.855414:0:10111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.855458:0:10111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd399bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd2 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.855474:0:10111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd399bf9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd2 expref: 17 pid: 6532 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302286.855524:0:10111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10111:1876219121511808:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302286.855629:0:10111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484e85f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302286.869022:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302286.869145:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101513344 00000100:00100000:3.0:1789302286.869158:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101513344 00010000:00010000:3.0:1789302286.869217:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd399bf9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd2 expref: 18 pid: 6532 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302286.869267:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 74 00000100:00100000:3.0:1789302286.869279:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+18:2399:x1876219101513344:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302286.869298:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302286.869306:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd399bf9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd2 expref: 18 pid: 6532 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.869322:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd399bf9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd2 expref: 18 pid: 6532 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.869349:0:13201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302286.869355:0:13201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.869367:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.869376:0:13201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.869399:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302286.869474:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+18:2399:x1876219101513344:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 197us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302286.869501:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 74 00010000:00010000:2.0:1789302286.872105:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd399bf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd2 expref: 17 pid: 6532 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302286.872162:0:10111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10111:1876219121511808:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302286.872202:0:10111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.872215:0:10111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.872222:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.872276:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.872284:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.872292:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.872298:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302286.872304:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.872338:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.872359:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302286.872362:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789302286.872368:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.872386:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c3f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302286.872490:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+16:11402:x1876219101513216:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 17209us (17455us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789302286.872502:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 138 00000100:00100000:0.0:1789302286.875860:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.876046:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101513472 00000100:00100000:1.0:1789302286.876060:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101513472 00000100:00100000:1.0:1789302286.876369:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 53 00000100:00100000:1.0:1789302286.876391:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101513472:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789302286.876452:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.876477:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.876509:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302286.876514:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302286.876520:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.876566:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 7 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.876582:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 7 pid: 8445 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302286.876600:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383be4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121511936:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302286.876698:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302286.879469:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383be4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121511936:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302286.879506:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302286.888218:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.892319:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101513600 00000100:00100000:1.0:1789302286.892340:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101513600 00010000:00010000:1.0:1789302286.892411:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 8 pid: 8445 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302286.892460:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 75 00000100:00100000:1.0:1789302286.892471:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+8:2399:x1876219101513600:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302286.892494:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302286.892525:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 8 pid: 8445 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.892570:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 8 pid: 8445 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.892603:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be48d78b/0x1ff82925bd399c23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bee expref: 8 pid: 8445 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.892624:0:6515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302286.892630:0:6515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302286.892637:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.892648:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302286.892694:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302286.892865:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101513600:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 394us (4672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302286.892873:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 75 00010000:00010000:3.0:1789302286.896063:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.896090:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.896175:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.896187:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.896208:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.896217:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aae00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302286.896222:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.896233:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.896282:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.896291:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003caae6a8/0x1ff82925bd399c46 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302286.896409:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101513472:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 20024us (20558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302286.896419:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 53 00000100:00100000:1.0:1789302286.910014:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.911004:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101513856 00000100:00100000:2.0:1789302286.911021:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101513856 00000100:00100000:2.0:1789302286.911106:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 139 00000100:00100000:2.0:1789302286.911155:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+16:11402:x1876219101513856:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789302286.911276:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.911298:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399b3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b9a expref: 16 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.911310:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.911358:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399b3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b9a expref: 16 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.911395:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399b3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b9a expref: 16 pid: 9541 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302286.911413:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121512064:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302286.911816:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484e85f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302286.917704:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.918051:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101513984 00000100:00100000:0.0:1789302286.918064:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101513984 00010000:00010000:0.0:1789302286.918161:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399b3c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b9a expref: 17 pid: 9541 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302286.918221:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 76 00000100:00100000:0.0:1789302286.918234:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+17:2398:x1876219101513984:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302286.918254:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302286.918262:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399b3c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b9a expref: 17 pid: 9541 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.918299:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399b3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b9a expref: 17 pid: 9541 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.918328:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:0.0:1789302286.918336:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bbd expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.918349:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.918358:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.918367:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.918390:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302286.918460:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+17:2398:x1876219101513984:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 228us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302286.918467:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 76 00010000:00010000:2.0:1789302286.920684:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3a00/0x1ff82925bd399b3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b9a expref: 16 pid: 9541 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302286.920715:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121512064:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302286.920756:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.920769:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.920776:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.921022:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.921038:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399c07 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd9 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.921047:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.921483:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399c07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd9 expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.921523:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399c07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd9 expref: 16 pid: 6530 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302286.921542:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121512192:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302286.921661:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484e85600 going to sleep for 11 seconds 00000100:00100000:2.0:1789302286.926773:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121512192:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302286.926814:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302286.927642:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302286.927824:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101514112 00000100:00100000:0.0:1789302286.927836:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101514112 00010000:00010000:0.0:1789302286.927887:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399c07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd9 expref: 17 pid: 6530 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302286.927935:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 77 00000100:00100000:0.0:1789302286.927946:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+17:2399:x1876219101514112:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302286.927986:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302286.927994:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399c07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd9 expref: 17 pid: 6530 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.928008:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399c07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd9 expref: 17 pid: 6530 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.928034:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399c07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bd9 expref: 17 pid: 6530 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.928054:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:0.0:1789302286.928071:0:10408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.928089:0:10408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.928097:0:10408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.928158:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302286.928245:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+16:2399:x1876219101514112:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 300us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302286.928253:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 77 00010000:00010000:2.0:1789302286.928331:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.928340:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302286.928494:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1789302286.928630:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:2.0:1789302286.928674:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1789302286.928774:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6531:1876219121512320:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789302286.928838:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302286.928872:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484e853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302286.929270:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121512320 00000100:00100000:0.0:1789302286.929278:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121512320 00000100:00100000:0.0:1789302286.929329:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789302286.929338:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6531:x1876219121512320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789302286.929450:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6531:x1876219121512320:12345-0@lo:1000:mdt00_001.0 Request processed in 112us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302286.929470:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789302286.929545:0:6531:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1789302286.929553:0:6531:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:3.0:1789302286.929585:0:6531:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cc48838c700, transno 4294967310 00000004:00080000:3.0:1789302286.929602:0:6531:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cc48838dc00, transno 4294967311 00000100:00100000:3.0:1789302286.929611:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7ef8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6531:1876219121512320:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789302286.929759:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:3.0:1789302286.929810:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6531:1876219121512448:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789302286.929842:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302286.929870:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302286.930041:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121512448 00000100:00100000:0.0:1789302286.930048:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121512448 00000100:00100000:0.0:1789302286.930344:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789302286.930355:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6531:x1876219121512448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789302286.930701:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6531:x1876219121512448:12345-0@lo:1000:mdt00_001.0 Request processed in 347us (856us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789302286.930710:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789302286.931228:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6531:1876219121512448:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789302286.931292:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931304:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931312:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931331:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302286.931337:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931345:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931363:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302286.931366:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302286.931371:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931378:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd399c54 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931406:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931411:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931417:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931422:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302286.931424:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931429:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931558:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302286.931561:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302286.931569:0:6531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bbd expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931581:0:6531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b9e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bbd expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931592:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bbd expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.931628:0:6531:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bbd expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302286.931642:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121512576:192.168.203.9@tcp:105: 00000100:00100000:3.0:1789302286.931733:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302286.939785:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121512576:192.168.203.9@tcp:105: 00010000:00010000:3.0:1789302286.939828:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.939841:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399b97 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.939881:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399c5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.939899:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399c5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.939936:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399c5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.939951:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399c5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.939958:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399c5b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.939965:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399c5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.939971:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302286.939976:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399c5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.939984:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399c5b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.939997:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302286.940001:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302286.940005:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399c5b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.940011:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399c5b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.940022:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.940028:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.940041:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.940047:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302286.940050:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.940381:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.940394:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302286.940397:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789302286.940401:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302286.940407:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399c4d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302286.940774:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+19:11402:x1876219101513856:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 29619us (30775us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789302286.940786:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 139 00000020:00080000:3.0:1789302286.940794:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789302286.943945:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302286.943956:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789302286.945410:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789302286.945434:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789302286.950308:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.953713:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302286.960716:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101514240 00000100:00100000:2.0:1789302286.967139:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101514240 00000100:00100000:2.0:1789302286.967243:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101514496 00000100:00100000:2.0:1789302286.967246:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101514496 00000100:00100000:2.0:1789302286.967269:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:2.0:1789302286.967279:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+20:11401:x1876219101514240:12345-192.168.203.9@tcp:49:lfs.0 00000100:00100000:2.0:1789302286.967489:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+20:11401:x1876219101514240:12345-192.168.203.9@tcp:49:lfs.0 Request processed in 210us (17195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302286.967498:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:2.0:1789302286.967520:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 32 00000100:00100000:2.0:1789302286.967527:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+19:11402:x1876219101514496:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789302286.968245:0:6533:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789302286.968291:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:2.0:1789302286.968339:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399c62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.968359:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399c62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.968377:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399c62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.968389:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399c62 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.968396:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399c62 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.968403:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399c62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302286.968427:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302286.968529:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302286.968538:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399c62 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.968546:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302286.968551:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399c62 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.968561:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399c62 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.968578:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:0.0:1789302286.968580:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789302286.968586:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399c62 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.968593:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399c62 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302286.968607:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302286.968608:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302286.968610:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302286.968729:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+21:11402:x1876219101514496:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1200us (15027us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789302286.970579:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 32 00000020:00080000:2.0:1789302286.970614:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789302286.973074:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302286.973250:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101514752 00000100:00100000:1.0:1789302286.973263:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101514752 00000100:00100000:1.0:1789302286.973331:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 140 00000100:00100000:1.0:1789302286.973343:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+21:11401:x1876219101514752:12345-192.168.203.9@tcp:58:lfs.0 00000040:00080000:1.0:1789302286.973593:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789302286.973698:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+21:11401:x1876219101514752:12345-192.168.203.9@tcp:58:lfs.0 Request processed in 357us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302286.973707:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 140 00000100:00100000:1.0:1789302287.007829:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302287.007996:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101514880 00000100:00100000:2.0:1789302287.008010:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101514880 00000100:00100000:2.0:1789302287.008106:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 141 00000100:00100000:2.0:1789302287.008162:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+21:11404:x1876219101514880:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302287.008208:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302287.008238:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399c69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5bf5 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.008327:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399c70 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.008346:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399c70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.008361:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399c70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.008379:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399c77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.008387:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399c77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.008395:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399c77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.008491:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.008504:0:10111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bb6 expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.008536:0:10111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.008582:0:10111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bb6 expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.008598:0:10111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bb6 expref: 22 pid: 6531 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302287.008615:0:10111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10111:1876219121512704:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302287.008725:0:10111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484ed2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302287.013507:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302287.013672:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101515136 00000100:00100000:1.0:1789302287.013688:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101515136 00000100:00100000:1.0:1789302287.013769:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 33 00000100:00100000:1.0:1789302287.013782:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+23:6634:x1876219101515136:12345-192.168.203.9@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789302287.014152:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+24:6634:x1876219101515136:12345-192.168.203.9@tcp:35:ldlm_bl.0 Request processed in 333us (620us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789302287.014161:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 33 00000100:00100000:2.0:1789302287.014948:0:10111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f56a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10111:1876219121512704:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302287.014986:0:10111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302287.018275:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302287.018426:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101515264 00000100:00100000:2.0:1789302287.018440:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101515264 00010000:00010000:2.0:1789302287.018500:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bb6 expref: 24 pid: 6531 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302287.018551:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 78 00000100:00100000:2.0:1789302287.018564:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+24:2398:x1876219101515264:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302287.018585:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302287.018593:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bb6 expref: 24 pid: 6531 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.018624:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bb6 expref: 24 pid: 6531 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.018657:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2400/0x1ff82925bd399b89 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bb6 expref: 24 pid: 6531 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.018677:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:2.0:1789302287.018684:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.018695:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.018705:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302287.018749:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302287.018819:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+23:2398:x1876219101515264:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 257us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302287.018832:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 78 00010000:00010000:3.0:1789302287.020684:0:10111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020705:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302287.020784:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789302287.020809:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302287.020841:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020867:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020880:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399c70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020887:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399c70 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020895:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399c70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020901:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302287.020906:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399c70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020914:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399c70 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020932:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:3.0:1789302287.020936:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302287.020942:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399c70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020949:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399c70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020968:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399c77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020985:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399c77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020992:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399c77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.020997:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302287.021001:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399c77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.021008:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399c77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.021016:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cc4adc10b00) 00010000:00010000:3.0:1789302287.021019:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302287.021022:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399c77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.021028:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399c77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.021081:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399c69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bf5 expref: 23 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.021097:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bf5 expref: 22 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302287.021107:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302287.021109:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302287.021169:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348800, rc 0) 00000100:00100000:3.0:1789302287.021260:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+22:11404:x1876219101514880:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 13102us (13448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302287.021271:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 141 00010000:00010000:2.0:1789302287.764504:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789302287.957897:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302287.957910:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789302287.957945:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789302287.957955:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789302287.958175:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc486730700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121512832:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789302287.958318:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383bb7600 going to sleep for 11 seconds 00000100:00100000:1.0:1789302287.975297:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302287.975464:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101515392 00000100:00100000:2.0:1789302287.975473:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101515392 00000100:00100000:2.0:1789302287.975526:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 142 00000100:00100000:2.0:1789302287.975535:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+23:11416:x1876219101515392:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789302287.975571:0:6531:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789302287.975595:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc486730700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121512832:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789302287.975711:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+22:11416:x1876219101515392:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 176us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302287.975726:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 142 00000100:00100000:0.0:1789302287.992245:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302287.992412:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101515648 00000100:00100000:1.0:1789302287.992423:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101515648 00000100:00100000:1.0:1789302287.992492:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 143 00000100:00100000:1.0:1789302287.992513:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+22:11416:x1876219101515648:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302287.992533:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302287.992552:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c85 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5bfc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302287.992649:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399c8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302287.992665:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399c8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302287.992679:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399c8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302287.992691:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789302287.992795:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c85 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bfc expref: 25 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302287.992814:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399c8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bfc expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302287.992822:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302287.992824:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302287.992828:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aa000, rc 0) 00000100:00100000:1.0:1789302287.992887:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+24:11416:x1876219101515648:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 378us (656us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789302287.992894:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 143 00000100:00100000:0.0:1789302288.019898:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302288.019951:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302288.020395:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101515904 00000100:00100000:1.0:1789302288.020404:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101515904 00000100:00100000:1.0:1789302288.020482:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 144 00000100:00100000:1.0:1789302288.020494:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+24:11416:x1876219101515904:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789302288.020567:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.020585:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.020596:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302288.020979:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101516032 00000100:00100000:3.0:1789302288.020984:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101516032 00000100:00100000:3.0:1789302288.021018:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 10 00000100:00100000:3.0:1789302288.021027:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+25:2399:x1876219101516032:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302288.021037:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302288.021054:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399c8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bfc expref: 25 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302288.021070:0:13201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302288.021075:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302288.021136:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+24:2399:x1876219101516032:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 111us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302288.021143:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 10 00000100:00080000:0.0:1789302288.021726:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789302288.023425:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.023441:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c9a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.023449:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.023456:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302288.023460:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.023469:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c9a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.023485:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302288.023488:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302288.023494:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c9a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.023511:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399c9a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302288.023635:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+24:11416:x1876219101515904:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 3141us (3743us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789302288.023645:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 144 00000040:00080000:0.0:1789302288.024024:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302288.024028:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302288.025831:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789302288.025846:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789302288.032319:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302288.032358:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101516288 00000100:00100000:3.0:1789302288.032366:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101516288 00000100:00100000:3.0:1789302288.032418:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 34 00000100:00100000:3.0:1789302288.032428:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+24:11416:x1876219101516288:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789302288.032634:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+25:11416:x1876219101516288:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 206us (324us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789302288.032643:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 34 00000040:00080000:0.0:1789302288.070511:0:14280:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302288.070531:0:14280:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302288.070719:0:14280:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789302288.070728:0:14280:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789302288.333474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302288.333534:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101516544 00000100:00100000:1.0:1789302288.333544:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101516544 00000100:00100000:1.0:1789302288.333646:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 145 00000100:00100000:1.0:1789302288.333657:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+25:11429:x1876219101516544:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302288.333681:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302288.333701:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399ca1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c03 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.333818:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aae00/0x1ff82925bd399ca8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.333833:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aae00/0x1ff82925bd399ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.333845:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aae00/0x1ff82925bd399ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302288.333856:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789302288.333953:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399ca1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c03 expref: 28 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.333972:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aae00/0x1ff82925bd399ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c03 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.333995:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302288.333999:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789302288.334002:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aae00, rc 0) 00000100:00100000:1.0:1789302288.334065:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+27:11429:x1876219101516544:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 409us (601us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789302288.334073:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 145 00000100:00100000:3.0:1789302288.345156:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302288.345376:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101516672 00000100:00100000:1.0:1789302288.345387:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101516672 00000100:00100000:1.0:1789302288.345448:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 146 00000100:00100000:1.0:1789302288.345460:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+27:11429:x1876219101516672:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:1.0:1789302288.345520:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399cb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.345536:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.345547:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.345579:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.345586:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399cb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.345594:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.345600:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302288.345611:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.345619:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.345631:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:1.0:1789302288.345634:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302288.345638:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399cb6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302288.345644:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399cb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302288.345716:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+27:11429:x1876219101516672:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 258us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302288.345724:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 146 00000100:00100000:3.0:1789302288.458573:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302288.458665:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101516800 00000100:00100000:0.0:1789302288.458674:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101516800 00000100:00100000:0.0:1789302288.458784:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 54 00000100:00100000:0.0:1789302288.458795:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2396:x1876219101516800:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:0.0:1789302288.458812:0:8852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302288.458834:0:8852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052ee90b2/0x1ff82925bd399cbd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c0a expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302288.458860:0:8852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa6960e, atime: 0x6aa6960d, ctime: 0x6aa6960e, blocks: 0x8 00010000:00010000:0.0:1789302288.458879:0:8852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1789302288.458884:0:8852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302288.458895:0:8852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052ee90b2/0x1ff82925bd399cbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c0a expref: 7 pid: 8852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302288.458928:0:8852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000052ee90b2/0x1ff82925bd399cbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c0a expref: 7 pid: 8852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302288.458941:0:8852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311c400, rc 0) 00000100:00100000:0.0:1789302288.458999:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2396:x1876219101516800:12345-192.168.203.9@tcp:101:cat.0 Request processed in 206us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302288.459006:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 54 00000100:00080000:1.0:1789302288.459070:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302288.466326:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302288.466684:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101516928 00000100:00100000:2.0:1789302288.466695:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101516928 00002000:00100000:2.0:1789302288.466742:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8cc384296680 x1876219101516928/t0(0) o3->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:619/0 lens 488/0 e 0 to 0 dl 1789302299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302288.466753:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc384296680 with x1876219101516928 ext(0->4095) 00002000:00010000:2.0:1789302288.466769:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc384296680 00000100:00100000:2.0:1789302288.466845:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:2.0:1789302288.466855:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101516928:12345-192.168.203.9@tcp:3:cat.0 00000100:00100000:2.0:1789302288.467046:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101516928:12345-192.168.203.9@tcp:3:cat.0 Request processed in 192us (728us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789302288.467053:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3 00002000:00100000:2.0:1789302288.467060:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8cc384296680 x1876219101516928/t0(0) o3->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:619/0 lens 488/4536 e 0 to 0 dl 1789302299 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302288.467068:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc384296680 with x1876219101516928 ext(0->4095) 00002000:00010000:2.0:1789302288.467072:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc384296680 00010000:00010000:0.0:1789302288.788672:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302288.981392:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302288.981418:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121512960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789302288.981501:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302288.981974:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121512960 00000100:00100000:0.0:1789302288.981984:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121512960 00000100:00100000:0.0:1789302288.982042:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789302288.982051:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121512960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302288.982082:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789302288.982154:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121512960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302288.982161:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1789302288.982532:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302288.982547:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc486733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121513088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302288.982580:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302288.982632:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121512960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302288.985389:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121513088 00000100:00100000:1.0:1789302288.985401:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121513088 00000100:00100000:1.0:1789302288.985487:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789302288.985497:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121513088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302288.985519:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789302288.985600:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121513088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302288.985608:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789302288.985754:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc486733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121513088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789302288.987132:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789302289.815094:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302290.517929:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121513472:0@lo:400:kworker.0 00000100:00100000:0.0:1789302290.518016:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302290.518070:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121513984:0@lo:400:kworker.0 00000100:00100000:0.0:1789302290.518095:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302290.518140:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121514496:0@lo:400:kworker.0 00000100:00100000:0.0:1789302290.518162:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302290.518214:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789302290.518220:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121513600:0@lo:400:kworker.0 00000100:00100000:0.0:1789302290.518240:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302290.518260:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121514112:0@lo:400:kworker.0 00000100:00100000:0.0:1789302290.518281:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302290.518293:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121514624:0@lo:400:kworker.0 00000100:00100000:0.0:1789302290.518309:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302290.518415:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121513344:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.518455:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302290.518473:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121513856:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.518491:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302290.518505:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121514368:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.518521:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302290.518536:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789302290.518540:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121513216:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.518568:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302290.518588:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121513728:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.518607:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302290.518622:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121514240:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.518639:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302290.518651:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121514752:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.518669:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302290.518699:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121513472 00000100:00100000:2.0:1789302290.518707:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121513472 00000100:00100000:2.0:1789302290.518753:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121513728 00000100:00100000:2.0:1789302290.518755:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121513728 00000100:00100000:2.0:1789302290.518771:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789302290.518781:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121513472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.518836:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121513472:12345-0@lo:400:kworker.0 Request processed in 56us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.518843:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789302290.518858:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789302290.518863:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121513728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.518898:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121513728:12345-0@lo:400:kworker.0 Request processed in 35us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.518904:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789302290.518920:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121514112 00000100:00100000:2.0:1789302290.518923:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121514112 00000100:00100000:2.0:1789302290.518948:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121514624 00000100:00100000:2.0:1789302290.518950:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121514624 00000100:00100000:2.0:1789302290.518959:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121514240 00000100:00100000:2.0:1789302290.518961:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121514240 00000100:00100000:2.0:1789302290.518970:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121514752 00000100:00100000:2.0:1789302290.518972:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121514752 00000100:00100000:2.0:1789302290.518983:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789302290.518988:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121514112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519018:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121514112:12345-0@lo:400:kworker.0 Request processed in 29us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.519024:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789302290.519033:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789302290.519038:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121514624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519057:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121514624:12345-0@lo:400:kworker.0 Request processed in 19us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.519062:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789302290.519070:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789302290.519074:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876219121514240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519092:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876219121514240:12345-0@lo:400:kworker.0 Request processed in 18us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.519097:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789302290.519104:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789302290.519138:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121514752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519162:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121514752:12345-0@lo:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.519178:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789302290.519195:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121513984 00000100:00100000:2.0:1789302290.519198:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121513984 00000100:00100000:2.0:1789302290.519217:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121514496 00000100:00100000:2.0:1789302290.519220:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121514496 00000100:00100000:2.0:1789302290.519233:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121513600 00000100:00100000:2.0:1789302290.519235:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121513600 00000100:00100000:2.0:1789302290.519243:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121513344 00000100:00100000:2.0:1789302290.519244:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121513344 00000100:00100000:2.0:1789302290.519252:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121513856 00000100:00100000:2.0:1789302290.519254:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121513856 00000100:00100000:2.0:1789302290.519263:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121514368 00000100:00100000:2.0:1789302290.519265:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121514368 00000100:00100000:2.0:1789302290.519276:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789302290.519281:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121513984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519330:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121513984:12345-0@lo:400:kworker.0 Request processed in 38us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.519337:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789302290.519347:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789302290.519353:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121514496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519374:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121514496:12345-0@lo:400:kworker.0 Request processed in 22us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.519380:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789302290.519387:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789302290.519393:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121513600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519421:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121513600:12345-0@lo:400:kworker.0 Request processed in 29us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.519427:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789302290.519435:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789302290.519440:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121513344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519458:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121513344:12345-0@lo:400:kworker.0 Request processed in 18us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.519463:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789302290.519470:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789302290.519475:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121513856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519493:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121513856:12345-0@lo:400:kworker.0 Request processed in 18us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.519498:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789302290.519506:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789302290.519510:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121514368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519529:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121514368:12345-0@lo:400:kworker.0 Request processed in 18us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.519534:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789302290.519556:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121513216 00000100:00100000:2.0:1789302290.519560:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121513216 00000100:00100000:2.0:1789302290.519583:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789302290.519589:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121513216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519615:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121513216:12345-0@lo:400:kworker.0 Request processed in 26us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302290.519620:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00080000:2.0:1789302290.519669:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302290.519673:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302290.519676:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302290.519678:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302290.519703:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121513216:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519715:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121513728:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519724:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121514240:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519732:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1789302290.519738:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1789302290.519764:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cc4b7fb2a00, transno 4294967302 00000004:00080000:2.0:1789302290.519776:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1789302290.519789:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cc4b7ef9c00, transno 4294967305 00000100:00100000:2.0:1789302290.519793:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121514752:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519802:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121513344:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519809:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121513856:0@lo:400:kworker.0 00000100:00100000:2.0:1789302290.519817:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121514368:0@lo:400:kworker.0 00000100:00100000:0.0:1789302290.520279:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121513600:0@lo:400:kworker.0 00000100:00100000:0.0:1789302290.520290:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121514112:0@lo:400:kworker.0 00000100:00100000:0.0:1789302290.520301:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121514624:0@lo:400:kworker.0 00000100:00100000:0.0:1789302290.520310:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121513472:0@lo:400:kworker.0 00010000:00080000:0.0:1789302290.520332:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384295180 x1876219121513984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302290.520344:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121513984:0@lo:400:kworker.0 00010000:00080000:0.0:1789302290.520354:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384294380 x1876219121514496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302290.520363:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121514496:0@lo:400:kworker.0 00000100:00100000:3.0:1789302290.520812:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302290.520826:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121514880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302290.520875:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302290.520908:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121514880 00000100:00100000:3.0:1789302290.520913:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121514880 00000100:00100000:3.0:1789302290.520946:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789302290.520954:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121514880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789302290.521022:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302290.521060:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121514880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302290.521067:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789302290.521099:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121514880:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789302290.858381:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302291.028880:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121515008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302291.028952:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302291.029037:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302291.029044:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc486732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121515136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302291.029069:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302291.029190:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121515008 00000100:00100000:1.0:1789302291.029199:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121515008 00000100:00100000:1.0:1789302291.029249:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121515136 00000100:00100000:1.0:1789302291.029252:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121515136 00000100:00100000:1.0:1789302291.029278:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789302291.029286:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121515008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302291.029313:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302291.029372:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121515008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302291.029379:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789302291.029396:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789302291.029403:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121515136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302291.029412:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302291.029433:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121515136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302291.029439:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789302291.029474:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc486732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121515136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302291.029486:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121515008:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789302291.092322:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302291.092342:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302291.092361:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789302291.092370:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789302291.348874:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789302291.540534:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121515264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302291.540631:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302291.541004:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121515264 00000100:00100000:0.0:1789302291.541011:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121515264 00000100:00100000:0.0:1789302291.541048:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789302291.541055:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121515264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302291.541081:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789302291.541142:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121515264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302291.541149:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789302291.541184:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121515264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302291.808423:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302291.808455:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302291.808485:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302291.808544:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101517056 00000100:00100000:0.0:1789302291.808553:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101517056 00000100:00100000:0.0:1789302291.808619:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 390 00000100:00100000:0.0:1789302291.808630:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101517056:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302291.810196:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101517056:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 1561us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302291.810209:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 390 00000100:00100000:2.0:1789302291.811631:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302291.811680:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302291.811704:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302291.811728:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302291.811733:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101517568 00000100:00100000:2.0:1789302291.811748:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101517312 00000100:00100000:2.0:1789302291.811765:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101517312 00000100:00100000:3.0:1789302291.811805:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101517184 00000100:00100000:3.0:1789302291.811810:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101517184 00000100:00100000:2.0:1789302291.811814:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101517824 00000100:00100000:2.0:1789302291.811817:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101517824 00000100:00100000:2.0:1789302291.811833:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 319 00000100:00100000:2.0:1789302291.811841:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101517312:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302291.811897:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101517312:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 57us (3411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302291.811898:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101517696 00000100:00100000:3.0:1789302291.811902:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101517696 00000100:00100000:2.0:1789302291.811903:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 319 00000100:00100000:2.0:1789302291.811918:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 320 00000100:00100000:3.0:1789302291.811923:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 321 00000100:00100000:2.0:1789302291.811924:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101517824:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302291.811929:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101517696:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302291.811947:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101517824:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302291.811948:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2397:x1876219101517696:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302291.811953:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 320 00000100:00100000:0.0:1789302291.811967:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101517568 00000100:00080000:2.0:1789302291.811971:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302291.811976:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302291.811977:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789302291.811995:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101517440 00000100:00100000:0.0:1789302291.811998:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101517440 00000100:00100000:0.0:1789302291.812023:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 147 00000100:00100000:0.0:1789302291.812029:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101517568:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302291.812087:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 321 00000100:00100000:3.0:1789302291.812140:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 148 00000100:00100000:3.0:1789302291.812148:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+7:2397:x1876219101517440:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302291.812184:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+7:2397:x1876219101517440:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 37us (479us total) trans 0 rc 0/0 00000100:00080000:2.0:1789302291.812266:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302291.812439:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101517568:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 409us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302291.812780:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 148 00000100:00100000:0.0:1789302291.813395:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 147 00000100:00100000:0.0:1789302291.813497:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 322 00000100:00100000:0.0:1789302291.813504:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+27:2397:x1876219101517184:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302291.813560:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+27:2397:x1876219101517184:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 57us (5104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302291.813577:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 322 00000100:00080000:3.0:1789302291.815268:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789302291.860397:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302292.886166:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789302293.081326:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1789302293.081352:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1789302293.083614:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1789302293.083649:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cc382957540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789302293.083654:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc383972300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cc382957780 00000020:00080000:2.0:1789302293.083658:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc383972800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cc383b97000 00000020:00080000:2.0:1789302293.083682:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1789302293.083750:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302293.083761:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302293.083769:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302293.083775:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302293.083780:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302293.083788:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302293.083806:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:0.0:1789302293.083809:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302293.083813:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302293.083843:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399c38 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789302293.083959:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789302293.084040:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789302293.916983:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302294.100285:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121515392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789302294.100362:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302294.100650:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121515392 00000100:00100000:0.0:1789302294.100659:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121515392 00000100:00100000:0.0:1789302294.100719:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789302294.100728:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121515392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302294.100762:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789302294.100813:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121515392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302294.100821:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1789302294.101023:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302294.101065:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121515392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302294.102833:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302294.104787:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc486732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121515520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302294.105018:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302294.105093:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121515520 00000100:00100000:0.0:1789302294.105108:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121515520 00000100:00100000:0.0:1789302294.105202:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789302294.105210:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b612fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121515520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302294.105231:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789302294.105271:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b612fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121515520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302294.105277:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1789302294.105612:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302294.105782:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1789302294.105787:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1789302294.105821:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc486732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121515520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789302294.932743:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302295.257681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302295.257841:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101517952 00000100:00100000:0.0:1789302295.257852:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101517952 00000100:00100000:0.0:1789302295.257935:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 147 00000100:00100000:0.0:1789302295.257947:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+13:11090:x1876219101517952:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789302295.258058:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+13:11090:x1876219101517952:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 Request processed in 113us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302295.258081:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 147 00000100:00080000:2.0:1789302295.261832:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302295.265204:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302295.265286:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101518080 00000100:00100000:3.0:1789302295.265296:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101518080 00000100:00100000:3.0:1789302295.265372:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 148 00000100:00100000:3.0:1789302295.265383:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:11090:x1876219101518080:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789302295.265490:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:11090:x1876219101518080:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 Request processed in 108us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302295.265497:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 148 00000100:00080000:2.0:1789302295.265700:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302295.270090:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302295.270392:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101518336 00000100:00100000:0.0:1789302295.270406:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101518336 00000100:00100000:0.0:1789302295.270475:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 35 00000100:00100000:0.0:1789302295.270488:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+13:11090:x1876219101518336:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789302295.270795:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+14:11090:x1876219101518336:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 308us (718us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789302295.270804:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 35 00000100:00100000:0.0:1789302295.636722:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121515648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302295.636836:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302295.637159:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121515648 00000100:00100000:3.0:1789302295.637170:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121515648 00000100:00100000:3.0:1789302295.637245:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789302295.637256:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121515648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789302295.637321:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302295.637393:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121515648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302295.637401:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789302295.637547:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121515648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302295.638199:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121515776:0@lo:400:kworker.0 00000100:00100000:2.0:1789302295.638279:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121516160:0@lo:400:kworker.0 00000100:00100000:1.0:1789302295.638285:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302295.638346:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302295.638358:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121516288:0@lo:400:kworker.0 00000100:00100000:2.0:1789302295.638395:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121516672:0@lo:400:kworker.0 00000100:00100000:1.0:1789302295.638404:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302295.638453:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121516800:0@lo:400:kworker.0 00000100:00100000:2.0:1789302295.638455:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302295.638488:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121517184:0@lo:400:kworker.0 00000100:00100000:1.0:1789302295.638521:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302295.638530:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302295.638603:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121515904:0@lo:400:kworker.0 00000100:00100000:0.0:1789302295.638947:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121516160 00000100:00100000:0.0:1789302295.638956:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121516160 00000100:00100000:0.0:1789302295.639006:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121516288 00000100:00100000:0.0:1789302295.639009:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121516288 00000100:00100000:0.0:1789302295.639039:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121516800 00000100:00100000:0.0:1789302295.639042:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121516800 00000100:00100000:0.0:1789302295.639062:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789302295.639070:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121516160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302295.642515:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121515776 00000100:00100000:1.0:1789302295.642529:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121515776 00000100:00100000:3.0:1789302295.642587:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302295.642633:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121516416:0@lo:400:kworker.0 00000100:00100000:3.0:1789302295.642687:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302295.642702:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121516928:0@lo:400:kworker.0 00000100:00100000:3.0:1789302295.642724:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302295.642752:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121516672 00000100:00100000:3.0:1789302295.642757:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121516672 00000100:00100000:3.0:1789302295.642791:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121517184 00000100:00100000:3.0:1789302295.642795:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121517184 00000100:00100000:3.0:1789302295.642820:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789302295.642829:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121516672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302295.642883:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121516672:12345-0@lo:400:kworker.0 Request processed in 55us (4436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302295.642890:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789302295.642906:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789302295.642912:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121517184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302295.642941:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121517184:12345-0@lo:400:kworker.0 Request processed in 30us (4413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302295.642946:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789302295.643010:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121516032:0@lo:400:kworker.0 00000100:00100000:1.0:1789302295.643050:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789302295.643059:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302295.643064:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121515776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302295.643085:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121516544:0@lo:400:kworker.0 00000100:00100000:3.0:1789302295.643107:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302295.643160:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121517056:0@lo:400:kworker.0 00000100:00100000:3.0:1789302295.643205:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302295.643205:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121515776:12345-0@lo:400:kworker.0 Request processed in 145us (4923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302295.643216:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789302295.643254:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121515904 00000100:00100000:1.0:1789302295.643259:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121515904 00000100:00100000:3.0:1789302295.643261:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121516032 00000100:00100000:3.0:1789302295.643267:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121516032 00000100:00100000:1.0:1789302295.643279:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121516416 00000100:00100000:1.0:1789302295.643283:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121516416 00000100:00100000:1.0:1789302295.643307:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121516928 00000100:00100000:1.0:1789302295.643310:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121516928 00000100:00100000:3.0:1789302295.643314:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789302295.643324:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121516032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302295.643365:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121516032:12345-0@lo:400:kworker.0 Request processed in 43us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302295.643371:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789302295.643388:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121516544 00000100:00100000:3.0:1789302295.643391:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121516544 00000100:00100000:3.0:1789302295.643409:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121517056 00000100:00100000:3.0:1789302295.643412:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121517056 00000100:00100000:3.0:1789302295.643429:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789302295.643435:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121516544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302295.643464:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121516544:12345-0@lo:400:kworker.0 Request processed in 30us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302295.643470:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789302295.643480:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789302295.643486:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121517056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302295.645830:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789302295.645856:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121516288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302295.648233:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121517184:0@lo:400:kworker.0 00000100:00100000:2.0:1789302295.648293:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121516672:0@lo:400:kworker.0 00000100:00100000:2.0:1789302295.648401:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789302295.649206:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121516160:12345-0@lo:400:kworker.0 Request processed in 10132us (10857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302295.649219:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789302295.649261:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789302295.649270:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121515904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302295.649357:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121515904:12345-0@lo:400:kworker.0 Request processed in 89us (6831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302295.649382:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789302295.649396:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789302295.649404:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121516416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302295.649453:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121516416:12345-0@lo:400:kworker.0 Request processed in 51us (6766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302295.649459:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789302295.649472:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789302295.649480:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121516928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302295.649511:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876219121516928:12345-0@lo:400:kworker.0 Request processed in 32us (6786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302295.649517:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789302295.649929:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121516800:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789302295.649988:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302295.649995:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302295.649998:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302295.650476:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121515904:0@lo:400:kworker.0 00000100:00100000:2.0:1789302295.652782:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876219121516800:12345-0@lo:400:kworker.0 Request processed in 4368us (14259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302295.652799:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00080000:0.0:1789302295.653150:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384296300 x1876219121516416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302295.653167:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121516416:0@lo:400:kworker.0 00010000:00080000:0.0:1789302295.653190:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4bdbbf480 x1876219121516928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302295.653199:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121516928:0@lo:400:kworker.0 00000100:00100000:0.0:1789302295.653253:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121516160:0@lo:400:kworker.0 00000100:00100000:0.0:1789302295.653299:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121516800:0@lo:400:kworker.0 00000100:00100000:0.0:1789302295.653337:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121515776:0@lo:400:kworker.0 00000100:00100000:2.0:1789302295.653611:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121516032:0@lo:400:kworker.0 00000100:00100000:3.0:1789302295.653642:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7ef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121517056:12345-0@lo:400:kworker.0 Request processed in 10144us (10427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302295.653645:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121516544:0@lo:400:kworker.0 00000100:00100000:2.0:1789302295.653675:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121517056:0@lo:400:kworker.0 00000100:00100000:3.0:1789302295.653676:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789302295.654470:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121516288:12345-0@lo:400:kworker.0 Request processed in 8624us (16065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302295.654481:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789302295.654630:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121516288:0@lo:400:kworker.0 00010000:00010000:0.0:1789302295.957026:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302296.149418:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc486730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121517312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302296.149491:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302296.149900:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121517312 00000100:00100000:1.0:1789302296.149909:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121517312 00000100:00100000:1.0:1789302296.149973:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789302296.149983:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121517312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302296.150010:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302296.150050:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121517312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302296.150057:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789302296.150282:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc486730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121517312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302296.150456:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302296.150468:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121517440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302296.150498:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302296.150765:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121517440 00000100:00100000:1.0:1789302296.150769:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121517440 00000100:00100000:1.0:1789302296.150803:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789302296.150810:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121517440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302296.150821:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302296.150854:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121517440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302296.150860:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789302296.151585:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121517440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302296.663501:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121517568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302296.663573:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302296.663788:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121517568 00000100:00100000:0.0:1789302296.663798:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121517568 00000100:00100000:0.0:1789302296.663852:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789302296.663862:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121517568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302296.663897:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789302296.663954:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121517568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302296.663961:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789302296.664090:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121517568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302296.931237:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302296.931279:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302296.931299:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302296.931319:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302296.931340:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302296.931358:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302296.931382:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302296.931406:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101518848 00000100:00100000:1.0:1789302296.931416:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101518848 00000100:00100000:1.0:1789302296.931463:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101518976 00000100:00100000:1.0:1789302296.931466:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101518976 00000100:00100000:1.0:1789302296.931488:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 153 00000100:00100000:1.0:1789302296.931497:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101518848:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302296.931559:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101518848:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 63us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302296.931567:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 153 00000100:00100000:1.0:1789302296.931582:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 154 00000100:00100000:1.0:1789302296.931588:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101518976:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302296.932175:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101518976:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 585us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302296.932190:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 154 00000100:00100000:1.0:1789302296.932214:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101518592 00000100:00100000:1.0:1789302296.932266:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101518592 00000100:00100000:1.0:1789302296.932296:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101518720 00000100:00100000:1.0:1789302296.932299:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101518720 00000100:00100000:1.0:1789302296.932309:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101519104 00000100:00100000:1.0:1789302296.932311:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101519104 00000100:00100000:1.0:1789302296.932323:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101519232 00000100:00100000:1.0:1789302296.932325:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101519232 00000100:00100000:1.0:1789302296.932339:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 329 00000100:00100000:1.0:1789302296.932344:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:2398:x1876219101518592:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302296.932374:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:2398:x1876219101518592:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 29us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302296.932380:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 329 00000100:00100000:1.0:1789302296.932390:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 330 00000100:00100000:1.0:1789302296.932395:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101518720:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302296.932414:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101518720:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 18us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302296.932419:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 330 00000100:00100000:1.0:1789302296.932428:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 331 00000100:00100000:1.0:1789302296.932433:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101519104:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302296.932451:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101519104:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 18us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302296.932457:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 331 00000100:00100000:1.0:1789302296.932466:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 332 00000100:00100000:1.0:1789302296.932478:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101519232:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302296.932498:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101519232:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 21us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302296.932503:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 332 00000100:00080000:1.0:1789302296.932552:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789302296.932556:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302296.932558:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302296.932560:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302296.933584:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101518464 00000100:00100000:3.0:1789302296.933595:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101518464 00000100:00100000:3.0:1789302296.933652:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 392 00000100:00100000:3.0:1789302296.933661:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101518464:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302296.933699:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101518464:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 40us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302296.933706:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 392 00010000:00010000:2.0:1789302296.984361:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789302297.830575:0:14477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:24:55 (1789302295) 00010000:00010000:0.0:1789302298.004958:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789302298.710728:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:2.0:1789302298.710744:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789302298.710977:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789302298.710989:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789302299.028549:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302299.221127:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302299.221154:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121517696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302299.221239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302299.221417:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121517696 00000100:00100000:0.0:1789302299.221425:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121517696 00000100:00100000:0.0:1789302299.221487:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789302299.221496:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121517696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302299.221534:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789302299.221592:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121517696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302299.221600:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1789302299.222224:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302299.222235:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302299.222247:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc486731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121517824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302299.222284:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302299.222349:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121517696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302299.222515:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121517824 00000100:00100000:1.0:1789302299.222529:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121517824 00000100:00100000:1.0:1789302299.222570:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789302299.222577:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121517824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302299.222591:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789302299.222625:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121517824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302299.222630:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789302299.223081:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302299.223138:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc486731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121517824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302299.722814:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302299.723552:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101519488 00000100:00100000:1.0:1789302299.723568:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101519488 00000100:00100000:0.0:1789302299.725860:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 149 00000100:00100000:0.0:1789302299.725883:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+13:12148:x1876219101519488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302299.725913:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302299.725945:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd399cc4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c11 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726067:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399ccb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726085:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399ccb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726100:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399ccb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726166:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399cd2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726174:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726182:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726311:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd399cd9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726320:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd399cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726349:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd399cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302299.726362:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789302299.726514:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399ccb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726524:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399ccb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726532:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399ccb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726538:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311de00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302299.726544:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399ccb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726554:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399ccb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726569:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cc486113200) 00010000:00010000:0.0:1789302299.726573:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302299.726580:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399ccb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.726587:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399ccb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.733294:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.733316:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.733352:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.733360:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311da00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302299.733366:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.733376:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.733409:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cc488eac300) 00010000:00010000:0.0:1789302299.733413:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302299.733420:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399cd2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.733427:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd399cd2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.737772:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311dc00/0x1ff82925bd399cc4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c11 expref: 16 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.738082:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd399cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c11 expref: 15 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302299.738096:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:0.0:1789302299.738099:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302299.738129:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311cc00, rc 0) 00000100:00100000:0.0:1789302299.738246:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+15:12148:x1876219101519488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 12369us (15461us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789302299.738280:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 149 00000100:00080000:3.0:1789302299.744070:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302299.744378:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302299.744479:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302299.744731:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101519744 00000100:00100000:1.0:1789302299.744745:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101519744 00000100:00100000:1.0:1789302299.744826:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 150 00000100:00100000:1.0:1789302299.744839:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+15:12148:x1876219101519744:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789302299.744983:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+15:12148:x1876219101519744:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 Request processed in 146us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302299.745005:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 150 00000100:00100000:3.0:1789302299.745890:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101519616 00000100:00100000:3.0:1789302299.745901:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101519616 00000100:00100000:3.0:1789302299.745965:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 11 00000100:00100000:3.0:1789302299.745975:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+15:2398:x1876219101519616:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302299.745989:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302299.746876:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd399cd9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c11 expref: 15 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302299.746929:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:3.0:1789302299.746935:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302299.747016:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+14:2398:x1876219101519616:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1037us (2641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302299.747026:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 11 00000100:00100000:3.0:1789302299.751364:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302299.751763:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101519872 00000100:00100000:1.0:1789302299.751776:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101519872 00000100:00100000:1.0:1789302299.751885:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 151 00000100:00100000:1.0:1789302299.751899:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:12148:x1876219101519872:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789302299.752323:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:12148:x1876219101519872:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 Request processed in 425us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302299.752331:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 151 00000100:00080000:3.0:1789302299.752990:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789302300.052387:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789302300.309509:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302300.309522:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789302300.310045:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789302300.310059:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789302300.567575:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789302300.757086:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121517952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302300.757237:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302300.757336:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121517952 00000100:00100000:2.0:1789302300.757347:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121517952 00000100:00100000:2.0:1789302300.757405:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789302300.757415:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121517952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302300.757460:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789302300.757517:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121517952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302300.757524:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789302300.757579:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121517952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302300.759200:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121518336:0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.759278:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302300.759337:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121518848:0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.759364:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302300.759389:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121519360:0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.759413:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302300.759441:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789302300.759448:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121518464:0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.759474:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302300.759493:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121518976:0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.759514:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302300.759532:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121519488:0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.759581:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302300.759619:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121518848 00000100:00100000:1.0:1789302300.759627:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121518848 00000100:00100000:1.0:1789302300.759673:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121519360 00000100:00100000:1.0:1789302300.759676:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121519360 00000100:00100000:1.0:1789302300.759702:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121518976 00000100:00100000:1.0:1789302300.759705:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121518976 00000100:00100000:1.0:1789302300.759715:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121519488 00000100:00100000:1.0:1789302300.759717:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121519488 00000100:00100000:1.0:1789302300.759735:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789302300.759744:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121518848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.759805:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121518848:12345-0@lo:400:kworker.0 Request processed in 61us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302300.759813:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789302300.760311:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121518336 00000100:00100000:3.0:1789302300.760318:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121518336 00000100:00100000:3.0:1789302300.760352:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789302300.760410:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121518336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302300.760466:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121518336:12345-0@lo:400:kworker.0 Request processed in 107us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302300.760473:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789302300.760501:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789302300.760510:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121519360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302300.760544:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121519360:12345-0@lo:400:kworker.0 Request processed in 37us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302300.760550:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789302300.760563:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789302300.760569:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121518976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302300.760599:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121518976:12345-0@lo:400:kworker.0 Request processed in 31us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302300.760604:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789302300.760624:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789302300.760630:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121519488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302300.760661:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121519488:12345-0@lo:400:kworker.0 Request processed in 31us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302300.760667:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1789302300.760689:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302300.761191:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121518080:0@lo:400:kworker.0 00000100:00100000:2.0:1789302300.761246:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302300.761288:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121518592:0@lo:400:kworker.0 00000100:00100000:2.0:1789302300.761316:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302300.761341:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121519104:0@lo:400:kworker.0 00000100:00100000:2.0:1789302300.761363:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302300.761386:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789302300.761394:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121518208:0@lo:400:kworker.0 00000100:00100000:2.0:1789302300.761429:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302300.761448:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121518720:0@lo:400:kworker.0 00000100:00100000:2.0:1789302300.761469:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302300.761488:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121519232:0@lo:400:kworker.0 00000100:00100000:2.0:1789302300.761508:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302300.761539:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121518464 00000100:00100000:2.0:1789302300.761546:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121518464 00000100:00100000:2.0:1789302300.761578:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121518592 00000100:00100000:2.0:1789302300.761581:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121518592 00000100:00100000:2.0:1789302300.761604:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121519104 00000100:00100000:2.0:1789302300.761606:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121519104 00000100:00100000:2.0:1789302300.761619:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121518208 00000100:00100000:2.0:1789302300.761622:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121518208 00000100:00100000:2.0:1789302300.761634:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121518720 00000100:00100000:2.0:1789302300.761637:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121518720 00000100:00100000:2.0:1789302300.761648:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121519232 00000100:00100000:2.0:1789302300.761650:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121519232 00000100:00100000:2.0:1789302300.761664:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789302300.761673:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121518464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302300.761714:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121518464:12345-0@lo:400:kworker.0 Request processed in 43us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302300.761722:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789302300.761736:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789302300.761742:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121518592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302300.761782:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121518592:12345-0@lo:400:kworker.0 Request processed in 31us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302300.761789:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789302300.761801:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789302300.761815:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121519104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302300.764535:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121518080 00000100:00100000:3.0:1789302300.764558:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121518080 00000100:00100000:3.0:1789302300.764637:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789302300.764649:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121518080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302300.764801:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789302300.764816:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121518208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.766185:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121518464:0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.766208:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121518976:0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.766223:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121519488:0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.766235:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121518336:0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.766248:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121518848:0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.766260:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121519360:0@lo:400:kworker.0 00000100:00100000:3.0:1789302300.777319:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121518080:12345-0@lo:400:kworker.0 Request processed in 12656us (16056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302300.777340:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789302300.778997:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789302300.779026:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121518720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302300.779264:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121518720:12345-0@lo:400:kworker.0 Request processed in 253us (17792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302300.780412:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121518208:12345-0@lo:400:kworker.0 Request processed in 15594us (18974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302300.780427:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789302300.780474:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789302300.780487:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121519232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302300.780558:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121519232:12345-0@lo:400:kworker.0 Request processed in 76us (19048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302300.780564:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1789302300.781108:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:0.0:1789302300.781388:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302300.781397:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302300.787308:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121518208:0@lo:400:kworker.0 00010000:00080000:0.0:1789302300.787337:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc3843dca80 x1876219121518720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302300.787350:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121518720:0@lo:400:kworker.0 00010000:00080000:0.0:1789302300.787365:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384296a00 x1876219121519232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302300.787374:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121519232:0@lo:400:kworker.0 00000100:00100000:0.0:1789302300.787386:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121518080:0@lo:400:kworker.0 00000100:00100000:0.0:1789302300.787399:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121518592:0@lo:400:kworker.0 00000100:00100000:2.0:1789302300.791616:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121519104:12345-0@lo:400:kworker.0 Request processed in 29786us (30236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302300.791638:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789302300.791807:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121519104:0@lo:400:kworker.0 00010000:00010000:3.0:1789302301.079150:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302301.271074:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302301.271130:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc486730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121519616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302301.271223:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302301.271306:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121519616 00000100:00100000:1.0:1789302301.271316:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121519616 00000100:00100000:1.0:1789302301.271375:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789302301.271385:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121519616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302301.271428:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302301.271493:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121519616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302301.271500:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789302301.271562:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc486730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121519616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302301.281162:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121519744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302301.281257:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302301.281365:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121519744 00000100:00100000:2.0:1789302301.281376:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121519744 00000100:00100000:2.0:1789302301.281440:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789302301.281453:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121519744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302301.281484:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302301.288952:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121519744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7486us (7681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302301.288970:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789302301.305364:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121519744:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1789302301.332506:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302301.332521:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789302301.332652:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1789302301.332659:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789302301.589161:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789302301.783565:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121519872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302301.783661:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302301.783749:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121519872 00000100:00100000:2.0:1789302301.783760:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121519872 00000100:00100000:2.0:1789302301.783944:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789302301.783956:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121519872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302301.784001:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789302301.784056:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121519872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302301.784064:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789302301.789344:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121519872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302302.041511:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.041543:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.041565:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.041583:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.041603:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.041621:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.041642:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.041669:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101520000 00000100:00100000:3.0:1789302302.041689:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101520000 00000100:00100000:3.0:1789302302.041737:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 394 00000100:00100000:3.0:1789302302.041746:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101520000:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302302.041998:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2399:x1876219101520000:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 251us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302302.042007:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 394 00000100:00100000:3.0:1789302302.042038:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101520256 00000100:00100000:3.0:1789302302.042043:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101520256 00000100:00100000:3.0:1789302302.044103:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101520768 00000100:00100000:3.0:1789302302.044126:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101520768 00000100:00100000:3.0:1789302302.044233:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101520128 00000100:00100000:3.0:1789302302.044237:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101520128 00000100:00100000:3.0:1789302302.044253:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101520640 00000100:00100000:3.0:1789302302.044255:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101520640 00000100:00100000:3.0:1789302302.044273:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 339 00000100:00100000:3.0:1789302302.044282:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101520256:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302302.044346:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101520256:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 65us (2802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302302.044353:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 339 00000100:00100000:3.0:1789302302.044368:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 340 00000100:00100000:3.0:1789302302.044373:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101520768:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302302.044393:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101520768:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 20us (2810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302302.044399:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 340 00000100:00100000:3.0:1789302302.044408:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 341 00000100:00100000:3.0:1789302302.044413:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:2399:x1876219101520128:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302302.044444:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:2399:x1876219101520128:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 30us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302302.044450:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 341 00000100:00100000:3.0:1789302302.044460:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 342 00000100:00100000:3.0:1789302302.044465:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101520640:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302302.044482:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2399:x1876219101520640:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 18us (2840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302302.044488:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 342 00000100:00100000:3.0:1789302302.044509:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101520512 00000100:00100000:3.0:1789302302.044512:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101520512 00000100:00100000:3.0:1789302302.044539:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101520384 00000100:00100000:3.0:1789302302.044542:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101520384 00000100:00100000:3.0:1789302302.044559:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 159 00000100:00100000:3.0:1789302302.044565:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101520512:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302302.044586:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2399:x1876219101520512:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (3021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302302.044592:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 159 00000100:00100000:3.0:1789302302.044601:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 160 00000100:00100000:3.0:1789302302.044606:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101520384:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302302.044625:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101520384:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 19us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302302.044631:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 160 00000100:00080000:0.0:1789302302.052966:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302302.052974:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302302.052978:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302302.052989:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789302302.100498:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302302.683418:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.683538:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101520896 00000100:00100000:3.0:1789302302.683548:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101520896 00000100:00100000:3.0:1789302302.683612:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 152 00000100:00100000:3.0:1789302302.683629:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:12191:x1876219101520896:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302302.683649:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302302.683670:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399ce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c18 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683733:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399cee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683749:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399cee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683760:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399cee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683774:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399cf5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683782:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683789:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683834:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399cee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683841:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399cee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683848:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399cee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683864:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302302.683868:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399cee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683877:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399cee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683889:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa9500) 00010000:00010000:3.0:1789302302.683892:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302302.683898:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399cee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683903:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399cee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683914:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683921:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683927:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683933:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302302.683935:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683941:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683957:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cc381fa9600) 00010000:00010000:3.0:1789302302.683960:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302302.683963:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399cf5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.683969:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399cf5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.684014:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399ce7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c18 expref: 15 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.684025:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa9500) 00010000:00010000:3.0:1789302302.684028:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302302.684032:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399ce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c18 expref: 15 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.684042:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982000, rc 0) 00000100:00100000:3.0:1789302302.684101:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+14:12191:x1876219101520896:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 474us (695us total) trans 0 rc 301/301 00000100:00100000:3.0:1789302302.684108:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 152 00000100:00100000:3.0:1789302302.696353:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302302.696419:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101521152 00000100:00100000:1.0:1789302302.696429:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101521152 00000100:00100000:1.0:1789302302.696490:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 153 00000100:00100000:1.0:1789302302.696508:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+14:12191:x1876219101521152:12345-192.168.203.9@tcp:36:lfs.0 00010000:00010000:1.0:1789302302.696562:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302302.696597:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399649 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a43 expref: 14 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.696615:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa9500) 00010000:00010000:1.0:1789302302.696624:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302302.696682:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399cfc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.696696:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399cfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.696705:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399cfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.696717:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.696724:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.696729:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697223:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697233:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697240:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302302.697265:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011c709ce reply state 00000000c8ead7ad transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697277:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697283:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302302.697285:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789302302.697288:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789302302.697293:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789302302.697299:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399cfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697307:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399cfc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697313:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399cfc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697319:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302302.697323:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399cfc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697331:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399cfc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697339:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383960700) 00010000:00010000:1.0:1789302302.697341:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302302.697345:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399cfc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697360:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399cfc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302302.697377:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011c709ce reply state 00000000c8ead7ad transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697386:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302302.697392:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cc383960500) 00010000:00010000:1.0:1789302302.697394:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789302302.697397:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789302302.697477:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+15:12191:x1876219101521152:12345-192.168.203.9@tcp:36:lfs.0 Request processed in 971us (1130us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789302302.697484:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 153 00000100:00100000:0.0:1789302302.830645:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302302.830747:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101521280 00000100:00100000:2.0:1789302302.830766:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101521280 00000100:00100000:2.0:1789302302.830837:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 154 00000100:00100000:2.0:1789302302.830848:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+15:12199:x1876219101521280:12345-192.168.203.9@tcp:101:lctl.0 00010000:00010000:2.0:1789302302.830872:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302302.830895:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399d11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c1f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302302.830960:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399d18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302302.830973:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399d18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302302.830985:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399d18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302302.831043:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789302302.831047:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302302.831069:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399d18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302302.831106:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399d11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c1f expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302302.831166:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399d18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c1f expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302302.831175:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc490721200) 00010000:00010000:2.0:1789302302.831177:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302302.831180:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348200, rc 0) 00000100:00100000:2.0:1789302302.831230:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+16:12199:x1876219101521280:12345-192.168.203.9@tcp:101:lctl.0 Request processed in 383us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302302.831244:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 154 00000100:00100000:2.0:1789302302.922597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.922686:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101521408 00000100:00100000:3.0:1789302302.922697:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101521408 00000100:00100000:3.0:1789302302.922756:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 155 00000100:00100000:3.0:1789302302.922767:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+16:12205:x1876219101521408:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302302.922796:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302302.922817:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399d1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c26 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.922895:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.922909:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.922920:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.922930:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.922936:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.922941:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923012:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399d34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923019:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923026:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302302.923067:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789302302.923070:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302302.923095:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399d34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923168:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923176:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923182:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923188:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302302.923192:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923199:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923211:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc490721200) 00010000:00010000:3.0:1789302302.923213:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302302.923218:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923224:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923247:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923253:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923258:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923270:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302302.923272:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923278:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923294:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cc383960500) 00010000:00010000:3.0:1789302302.923297:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302302.923300:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923305:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923329:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399d1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c26 expref: 18 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923342:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399d34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c26 expref: 17 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.923349:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302302.923351:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789302302.923354:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982a00, rc 0) 00000100:00100000:3.0:1789302302.923417:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+17:12205:x1876219101521408:12345-192.168.203.9@tcp:101:bash.0 Request processed in 653us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302302.923424:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 155 00000100:00100000:0.0:1789302302.929975:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.931418:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101521664 00000100:00100000:3.0:1789302302.931446:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101521664 00000100:00100000:3.0:1789302302.931610:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 156 00000100:00100000:3.0:1789302302.931622:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+17:12205:x1876219101521664:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302302.931644:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302302.931666:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399d3b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c2d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.931775:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d42 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.931789:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.931801:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.931965:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.931973:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.931980:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789302302.932375:0:6532:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789302302.932512:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399d50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932520:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399d50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932538:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399d50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932570:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d42 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932577:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d42 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932583:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932588:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302302.932592:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d42 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932599:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d42 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932609:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302302.932611:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302302.932616:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d42 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932621:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399d42 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302302.932633:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008018927a reply state 00000000e6a8e4cf transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932642:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932654:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc381fa9600) 00010000:00010000:3.0:1789302302.932656:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302302.932658:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789302302.932688:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399d3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c2d expref: 20 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932701:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399d50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c2d expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.932708:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:3.0:1789302302.932710:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302302.932713:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983e00, rc 0) 00000100:00100000:3.0:1789302302.932781:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+20:12205:x1876219101521664:12345-192.168.203.9@tcp:101:bash.0 Request processed in 1161us (2815us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789302302.932788:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 156 00000100:00100000:0.0:1789302302.954190:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.954269:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101521792 00000100:00100000:3.0:1789302302.954279:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101521792 00000100:00100000:3.0:1789302302.954342:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 55 00000100:00100000:3.0:1789302302.954354:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2397:x1876219101521792:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302302.954372:0:8852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302302.954391:0:8852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b6d1ed9/0x1ff82925bd399d5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c34 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302302.954415:0:8852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302302.954433:0:8852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1789302302.954437:0:8852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302302.954460:0:8852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b6d1ed9/0x1ff82925bd399d5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c34 expref: 6 pid: 8852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.954481:0:8852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b6d1ed9/0x1ff82925bd399d5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c34 expref: 6 pid: 8852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.954495:0:8852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982000, rc 0) 00000100:00100000:3.0:1789302302.954561:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2397:x1876219101521792:12345-192.168.203.9@tcp:101:bash.0 Request processed in 209us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302302.954568:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 55 00000100:00100000:1.0:1789302302.958100:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.958220:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101521920 00000100:00100000:3.0:1789302302.958231:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101521920 00000100:00100000:3.0:1789302302.958291:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 56 00000100:00100000:3.0:1789302302.958301:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+6:12205:x1876219101521920:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302302.958321:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302302.958340:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c3b expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.958372:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b6d1ed9/0x1ff82925bd399d5e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c34 expref: 7 pid: 8852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.958381:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789302302.958386:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302302.958391:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.958425:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b6d1ed9/0x1ff82925bd399d5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c34 expref: 7 pid: 8852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.958453:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b6d1ed9/0x1ff82925bd399d5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c34 expref: 7 pid: 8852 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302302.958466:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1876219121520000:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302302.958578:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302302.961971:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1876219121520000:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302302.962020:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.962041:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983c00, rc 0) 00000100:00100000:3.0:1789302302.962151:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:12205:x1876219101521920:12345-192.168.203.9@tcp:101:bash.0 Request processed in 3850us (4069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302302.962160:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 56 00000100:00100000:0.0:1789302302.965104:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.965210:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101522048 00000100:00100000:3.0:1789302302.965220:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101522048 00010000:00010000:3.0:1789302302.965263:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b6d1ed9/0x1ff82925bd399d5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c34 expref: 7 pid: 8852 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302302.965304:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 79 00000100:00100000:3.0:1789302302.965313:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101522048:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302302.965328:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302302.965347:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b6d1ed9/0x1ff82925bd399d5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c34 expref: 7 pid: 8852 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.965379:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b6d1ed9/0x1ff82925bd399d5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c34 expref: 7 pid: 8852 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.965402:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b6d1ed9/0x1ff82925bd399d5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c34 expref: 7 pid: 8852 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.965419:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302302.965423:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302302.965430:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.965440:0:13201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302302.965474:0:13201:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302302.965489:0:13201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383443b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13201:1876219121520128:192.168.203.9@tcp:105: 00000100:00100000:3.0:1789302302.965572:0:13201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302302.968622:0:13201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383443b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13201:1876219121520128:192.168.203.9@tcp:105: 00010000:00010000:3.0:1789302302.968650:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302302.968707:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+6:2398:x1876219101522048:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 3394us (3611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302302.968718:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 79 00000100:00100000:1.0:1789302302.976903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302302.977145:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101522304 00000100:00100000:3.0:1789302302.977156:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101522304 00000100:00100000:3.0:1789302302.977207:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 36 00000100:00100000:3.0:1789302302.977217:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+20:12205:x1876219101522304:12345-192.168.203.9@tcp:35:bash.0 00000100:00100000:3.0:1789302302.977511:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+21:12205:x1876219101522304:12345-192.168.203.9@tcp:35:bash.0 Request processed in 294us (615us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789302302.977519:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 36 00010000:00010000:2.0:1789302303.124346:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302303.159878:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302303.159998:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101522560 00000100:00100000:3.0:1789302303.160008:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101522560 00000100:00100000:3.0:1789302303.160085:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 157 00000100:00100000:3.0:1789302303.160097:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+21:12215:x1876219101522560:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302303.160148:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302303.160177:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399d6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c42 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302303.160272:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789302303.160365:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399d6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c42 expref: 23 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.160379:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc490721200) 00010000:00010000:3.0:1789302303.160381:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302303.160386:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399d6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c42 expref: 23 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.160398:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982000, rc 0) 00000100:00100000:3.0:1789302303.160610:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+22:12215:x1876219101522560:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 514us (741us total) trans 4294967422 rc 301/301 00000100:00100000:3.0:1789302303.160634:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 157 00000100:00100000:1.0:1789302303.164911:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302303.165849:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101522816 00000100:00100000:3.0:1789302303.165860:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101522816 00000100:00100000:3.0:1789302303.165965:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 37 00000100:00100000:3.0:1789302303.165976:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+22:12215:x1876219101522816:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:3.0:1789302303.166562:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+23:12215:x1876219101522816:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 586us (1659us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789302303.166571:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 37 00000100:00100000:0.0:1789302303.287228:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302303.287359:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101522944 00000100:00100000:3.0:1789302303.287369:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101522944 00000100:00100000:3.0:1789302303.287438:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 158 00000100:00100000:3.0:1789302303.287449:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+23:12221:x1876219101522944:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302303.287471:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302303.287493:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399d7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c49 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.287558:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399d81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.287572:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399d81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.287584:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399d81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302303.287626:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789302303.287631:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302303.287665:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399d81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.287999:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399d7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c49 expref: 25 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.288020:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399d81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c49 expref: 24 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.288028:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302303.288031:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302303.288034:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982800, rc 0) 00000100:00100000:3.0:1789302303.288103:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+24:12221:x1876219101522944:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 655us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302303.289918:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 158 00000100:00100000:0.0:1789302303.304568:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302303.304650:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101523200 00000100:00100000:3.0:1789302303.304659:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101523200 00000100:00100000:3.0:1789302303.304729:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 159 00000100:00100000:3.0:1789302303.304741:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+24:12221:x1876219101523200:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302303.304760:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302303.304793:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399d88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c50 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.304906:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399d8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.304921:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399d8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.304933:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399d8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302303.304962:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789302303.305092:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399d88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c50 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.305331:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399d8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c50 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.305342:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:3.0:1789302303.305345:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302303.305349:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982c00, rc 0) 00000100:00100000:3.0:1789302303.305414:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+26:12221:x1876219101523200:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 675us (854us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789302303.305422:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 159 00000100:00100000:1.0:1789302303.311179:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302303.311224:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302303.311348:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101523328 00000100:00100000:2.0:1789302303.311359:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101523328 00000100:00100000:2.0:1789302303.311417:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:2.0:1789302303.311427:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+26:2397:x1876219101523328:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302303.311443:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302303.311465:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399d8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c50 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.311484:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:2.0:1789302303.311489:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302303.311551:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+25:2397:x1876219101523328:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 125us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302303.311558:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:3.0:1789302303.311632:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101523584 00000100:00100000:3.0:1789302303.311636:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101523584 00000100:00100000:3.0:1789302303.311667:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 160 00000100:00100000:3.0:1789302303.311685:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+25:12221:x1876219101523584:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302303.311704:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302303.311719:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399d9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c57 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.311823:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399da4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.311836:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399da4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.311864:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399da4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302303.311877:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789302303.311971:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399d9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c57 expref: 28 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.311986:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399da4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c57 expref: 27 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.311993:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:3.0:1789302303.311995:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789302303.311997:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983600, rc 0) 00000100:00100000:3.0:1789302303.312023:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+27:12221:x1876219101523584:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 350us (799us total) trans 4294967425 rc 0/0 00000100:00100000:3.0:1789302303.312028:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 160 00000100:00100000:1.0:1789302303.338845:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302303.338985:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101523712 00000100:00100000:3.0:1789302303.339004:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101523712 00000100:00100000:3.0:1789302303.339064:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 57 00000100:00100000:3.0:1789302303.339074:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101523712:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:3.0:1789302303.339169:0:8852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.339190:0:8852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.339198:0:8852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302303.339215:0:8852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302303.339219:0:8852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.339252:0:8852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 6 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.339265:0:8852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 6 pid: 8447 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302303.339278:0:8852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8852:1876219121520256:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302303.339361:0:8852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302303.346256:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302303.346914:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101523840 00000100:00100000:0.0:1789302303.346925:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101523840 00002000:00100000:0.0:1789302303.346975:0:8451:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8cc3843dfb80 x1876219101523840/t0(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:634/0 lens 504/0 e 0 to 0 dl 1789302314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789302303.346999:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc3843dfb80 with x1876219101523840 ext(0->12) 00010000:00010000:0.0:1789302303.347011:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 7 pid: 8447 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302303.347029:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 7 pid: 8447 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302303.347037:0:8451:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cc3843dfb80 00000100:00100000:0.0:1789302303.347071:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2 00000100:00100000:0.0:1789302303.347090:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101523840:12345-192.168.203.9@tcp:4:lfs.0 00000100:00100000:3.0:1789302303.348354:0:8852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8852:1876219121520256:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302303.348381:0:8852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302303.350252:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c76ee310-c3b4-4286-aaea-77936c269d98+9:2398:x1876219101523840:12345-192.168.203.9@tcp:4:lfs.0 Request processed in 3158us (3999us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789302303.350266:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2 00002000:00100000:0.0:1789302303.350279:0:8451:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8cc3843dfb80 x1876219101523840/t4294967306(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:634/0 lens 504/448 e 0 to 0 dl 1789302314 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789302303.350289:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc3843dfb80 with x1876219101523840 ext(0->12) 00010000:00010000:0.0:1789302303.350312:0:8451:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 9 pid: 8447 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302303.350329:0:8451:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 9 pid: 8447 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302303.350338:0:8451:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cc3843dfb80 00000100:00100000:1.0:1789302303.363247:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302303.363416:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101523968 00000100:00100000:3.0:1789302303.363427:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101523968 00010000:00010000:3.0:1789302303.363466:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 9 pid: 8447 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302303.363501:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 80 00000100:00100000:3.0:1789302303.363511:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+9:2399:x1876219101523968:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302303.363527:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789302303.363545:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789302303.363548:0:6517:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789302302 00002000:00010000:3.0:1789302303.363562:0:6517:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789302303 00002000:00010000:3.0:1789302303.363564:0:6517:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789302302 00002000:00010000:3.0:1789302303.363567:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789302303.363575:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 9 pid: 8447 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.363590:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 9 pid: 8447 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.363613:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd64402d/0x1ff82925bd399d65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c3b expref: 9 pid: 8447 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.363630:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302303.363635:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302303.363641:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.363651:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.363699:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302303.363769:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+8:2399:x1876219101523968:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 252us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302303.363777:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 80 00010000:00010000:1.0:1789302303.365001:0:8852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302303.365017:0:8852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302303.365254:0:8852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302303.365264:0:8852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302303.365274:0:8852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302303.365282:0:8852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982e00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302303.365286:0:8852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302303.365295:0:8852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302303.365311:0:8852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302303.365320:0:8852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd399db2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302303.365406:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101523712:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 26331us (26567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302303.365415:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 57 00000100:00100000:1.0:1789302303.373090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302303.373312:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101524224 00000100:00100000:0.0:1789302303.373323:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101524224 00000100:00100000:0.0:1789302303.373382:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 38 00000100:00100000:0.0:1789302303.373392:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+27:12221:x1876219101524224:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:0.0:1789302303.373452:0:6534:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399da4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c57 expref: 27 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302303.373639:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789302303.373690:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1789302303.374356:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:0.0:1789302303.374396:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302303.374412:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399d50 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c2d expref: 31 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302303.374421:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302303.374455:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399d50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c2d expref: 31 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302303.374490:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399d50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c2d expref: 31 pid: 6532 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302303.374506:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384294700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6534:1876219121520384:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302303.374581:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302303.376647:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384294700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6534:1876219121520384:192.168.203.9@tcp:104: 00010000:00010000:0.0:1789302303.376753:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302303.377234:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302303.377476:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101524352 00000100:00100000:3.0:1789302303.377485:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101524352 00010000:00010000:3.0:1789302303.377517:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399d50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c2d expref: 32 pid: 6532 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302303.377574:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 81 00000100:00100000:3.0:1789302303.377583:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+32:2399:x1876219101524352:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302303.377596:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302303.377603:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399d50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c2d expref: 32 pid: 6532 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.377615:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399d50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c2d expref: 32 pid: 6532 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.377634:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399d50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c2d expref: 32 pid: 6532 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.377647:0:13201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:3.0:1789302303.377652:0:13201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.377660:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.377667:0:13201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.377701:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302303.377747:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+31:2399:x1876219101524352:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 166us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302303.377753:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 81 00010000:00010000:0.0:1789302303.377970:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302303.377978:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302303.378092:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:0.0:1789302303.378386:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1789302303.378472:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384294700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6534:1876219121520512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789302303.378519:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302303.378548:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8840 going to sleep for 11 seconds 00000100:00100000:3.0:1789302303.379009:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121520512 00000100:00100000:3.0:1789302303.379026:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121520512 00000100:00100000:3.0:1789302303.379107:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789302303.379135:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6534:x1876219121520512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789302303.379403:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6534:x1876219121520512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 269us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302303.379411:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789302303.379483:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384294700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6534:1876219121520512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789302303.379593:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:2.0:1789302303.379643:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd968000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6534:1876219121520640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789302303.379693:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302303.379715:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383a38000 going to sleep for 11 seconds 00000100:00100000:3.0:1789302303.379987:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121520640 00000100:00100000:3.0:1789302303.379993:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121520640 00000100:00100000:3.0:1789302303.380027:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789302303.380036:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd96a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6534:x1876219121520640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789302303.380183:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd96a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6534:x1876219121520640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (489us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789302303.380190:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789302303.380365:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd968000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6534:1876219121520640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789302303.380406:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1789302303.380437:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.380460:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.380469:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.380475:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311c200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302303.380480:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.380488:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.380502:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:2.0:1789302303.380505:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789302303.380509:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.380515:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd399db9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302303.380604:0:6534:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789302303.380660:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000100:00080000:1.0:1789302303.380815:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789302303.380961:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379423557858ns, next at 380423555884ns, rc = 0 00000001:00080000:2.0:1789302303.380970:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:2.0:1789302303.380998:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:2.0:1789302303.381002:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789302303.381008:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399da4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c57 expref: 35 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302303.382091:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+34:12221:x1876219101524224:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 8697us (9013us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789302303.382100:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 38 00000020:00080000:2.0:1789302303.382105:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789302303.395070:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302303.395261:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101524480 00000100:00100000:2.0:1789302303.395271:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101524480 00000100:00100000:2.0:1789302303.395327:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 161 00000100:00100000:2.0:1789302303.395338:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+34:12221:x1876219101524480:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302303.395360:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302303.395383:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399dc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c5e expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.395445:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c5e expref: 35 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.395461:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c5e expref: 35 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.395479:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:2.0:1789302303.395482:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302303.395486:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349e00, rc 0) 00000100:00100000:2.0:1789302303.395539:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+35:12221:x1876219101524480:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 202us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302303.395546:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 161 00000100:00100000:3.0:1789302303.422296:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302303.422524:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101524736 00000100:00100000:0.0:1789302303.422534:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101524736 00000100:00100000:0.0:1789302303.422597:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 39 00000100:00100000:0.0:1789302303.422609:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+35:12221:x1876219101524736:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:2.0:1789302303.423479:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+36:12221:x1876219101524736:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 870us (1190us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789302303.423501:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 39 00000100:00100000:1.0:1789302303.664988:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302303.665195:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101524992 00000100:00100000:3.0:1789302303.665205:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101524992 00000100:00100000:3.0:1789302303.665283:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 162 00000100:00100000:3.0:1789302303.665293:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+36:12231:x1876219101524992:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302303.665315:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302303.665335:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399dc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c65 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302303.665707:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789302303.665885:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399dc7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c65 expref: 38 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.665900:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc490721200) 00010000:00010000:3.0:1789302303.665909:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302303.665915:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399dc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c65 expref: 38 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.665929:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983e00, rc 0) 00000100:00100000:3.0:1789302303.666180:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+37:12231:x1876219101524992:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 888us (1200us total) trans 4294967436 rc 301/301 00000100:00100000:3.0:1789302303.666189:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 162 00000100:00100000:1.0:1789302303.678755:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302303.679019:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101525120 00000100:00100000:2.0:1789302303.679030:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101525120 00000100:00100000:2.0:1789302303.679104:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 163 00000100:00100000:2.0:1789302303.679157:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+37:12231:x1876219101525120:12345-192.168.203.9@tcp:34:lfs.0 00010000:00010000:2.0:1789302303.679230:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399dd5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679249:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679261:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679273:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399ddc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679280:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679287:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679357:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399de3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679366:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679372:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302303.679439:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679452:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679459:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399dd5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679465:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679471:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302303.679475:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679483:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399dd5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679494:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302303.679497:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302303.679501:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399dd5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679507:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399dd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679521:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399ddc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679527:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399ddc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679538:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399ddc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679543:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302303.679546:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399ddc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679552:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399ddc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679559:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc381fa9600) 00010000:00010000:2.0:1789302303.679562:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302303.679565:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399ddc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679571:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399ddc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679580:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679587:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399de3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679592:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399de3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679597:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302303.679600:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399de3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679615:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399de3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679623:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:2.0:1789302303.679625:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302303.679628:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399de3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302303.679634:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399de3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302303.679719:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+37:12231:x1876219101525120:12345-192.168.203.9@tcp:34:lfs.0 Request processed in 605us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302303.679726:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 163 00000100:00100000:2.0:1789302303.689609:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302303.689810:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101525376 00000100:00100000:0.0:1789302303.689819:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101525376 00000100:00100000:0.0:1789302303.689884:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 40 00000100:00100000:0.0:1789302303.689894:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+37:12231:x1876219101525376:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:0.0:1789302303.690172:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+38:12231:x1876219101525376:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 278us (570us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789302303.690180:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 40 00000100:00100000:1.0:1789302303.770594:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302303.770684:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101525632 00000100:00100000:3.0:1789302303.770693:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101525632 00000100:00100000:3.0:1789302303.770753:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 164 00000100:00100000:3.0:1789302303.770824:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+38:12234:x1876219101525632:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302303.770847:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302303.770868:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399dea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c6c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.770944:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399df1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.770963:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399df1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.770974:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399df1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.770985:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399df8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.770992:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399df8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.771016:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399df8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.771719:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399dff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.771731:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399dff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.771739:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399dff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302303.771748:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789302303.772245:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399df1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772254:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399df1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772261:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399df1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772267:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302303.772271:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399df1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772278:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399df1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772291:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302303.772293:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302303.772307:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399df1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772314:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399df1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772328:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399df8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772335:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399df8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772340:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399df8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772344:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302303.772347:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399df8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772353:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399df8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772360:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc381fa9600) 00010000:00010000:3.0:1789302303.772362:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302303.772365:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399df8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772370:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399df8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772409:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399dea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c6c expref: 41 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772434:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399dff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c6c expref: 40 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.772441:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:3.0:1789302303.772443:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302303.772446:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983a00, rc 0) 00000100:00100000:3.0:1789302303.772581:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+40:12234:x1876219101525632:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1818us (1997us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789302303.772590:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 164 00000100:00100000:1.0:1789302303.782007:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302303.782098:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101525760 00000100:00100000:3.0:1789302303.782108:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101525760 00000100:00100000:3.0:1789302303.782185:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 165 00000100:00100000:3.0:1789302303.782195:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+40:12234:x1876219101525760:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:3.0:1789302303.782259:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.782275:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.782287:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.782321:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.782328:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.782364:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.782371:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302303.782375:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.782383:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.782395:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:3.0:1789302303.782398:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302303.782403:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302303.782409:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302303.782484:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+40:12234:x1876219101525760:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 290us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302303.782492:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 165 00000100:00100000:2.0:1789302303.790016:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302303.790167:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101526016 00000100:00100000:0.0:1789302303.790176:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101526016 00000100:00100000:0.0:1789302303.790232:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 41 00000100:00100000:0.0:1789302303.790242:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+40:12234:x1876219101526016:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:0.0:1789302303.790465:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+41:12234:x1876219101526016:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 224us (457us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789302303.790473:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 41 00010000:00010000:3.0:1789302304.148420:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302304.189238:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302304.189342:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101526272 00000100:00100000:0.0:1789302304.189351:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101526272 00000100:00100000:0.0:1789302304.189420:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 166 00000100:00100000:0.0:1789302304.189431:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+41:12265:x1876219101526272:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:0.0:1789302304.189454:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302304.189476:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399e14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c73 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.189577:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.189594:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.189608:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302304.189641:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789302304.189743:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399e14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c73 expref: 44 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.190174:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c73 expref: 43 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.190184:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:0.0:1789302304.190187:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302304.190191:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311ca00, rc 0) 00000100:00100000:0.0:1789302304.190255:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+43:12265:x1876219101526272:12345-192.168.203.9@tcp:101:cat.0 Request processed in 825us (1026us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1789302304.190263:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 166 00000100:00080000:1.0:1789302304.191442:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302304.210105:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302304.210265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101526400 00000100:00100000:0.0:1789302304.210278:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101526400 00000100:00100000:0.0:1789302304.210365:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:0.0:1789302304.210377:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+43:2396:x1876219101526400:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302304.210397:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302304.210428:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c73 expref: 43 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.210451:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:0.0:1789302304.210457:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302304.210527:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+42:2396:x1876219101526400:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 152us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302304.210536:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:2.0:1789302304.224714:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302304.225097:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101526656 00000100:00100000:0.0:1789302304.225143:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101526656 00000100:00100000:0.0:1789302304.225220:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 42 00000100:00100000:0.0:1789302304.225233:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+42:12265:x1876219101526656:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:0.0:1789302304.225838:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+43:12265:x1876219101526656:12345-192.168.203.9@tcp:35:cat.0 Request processed in 603us (1144us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789302304.225848:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 42 00000100:00100000:1.0:1789302304.300832:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302304.300960:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101526912 00000100:00100000:3.0:1789302304.300972:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101526912 00000100:00100000:3.0:1789302304.301066:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 167 00000100:00100000:3.0:1789302304.301088:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+43:12270:x1876219101526912:12345-192.168.203.9@tcp:101:dd.0 00010000:00010000:3.0:1789302304.301150:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302304.301155:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789302304.301193:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399d81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c49 expref: 43 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.301235:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302304.301241:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302304.301258:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e29 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c7a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.301863:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.301881:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399dff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c6c expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.301891:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.301931:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399dff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c6c expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.301946:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399dff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c6c expref: 43 pid: 6531 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302304.301962:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121520768:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302304.302811:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302304.309730:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302304.310002:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121520768:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302304.310042:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302304.310184:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101527040 00000100:00100000:2.0:1789302304.310194:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101527040 00010000:00010000:2.0:1789302304.310241:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399dff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c6c expref: 44 pid: 6531 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302304.310282:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 82 00000100:00100000:2.0:1789302304.310292:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+44:2398:x1876219101527040:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302304.310312:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302304.310320:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399dff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c6c expref: 44 pid: 6531 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.310356:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399dff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c6c expref: 44 pid: 6531 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.310397:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399dff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c6c expref: 44 pid: 6531 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.310415:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:2.0:1789302304.310421:0:10408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.310431:0:10408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.310440:0:10408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.310587:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302304.310933:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+43:2398:x1876219101527040:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 640us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302304.310943:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 82 00010000:00010000:1.0:1789302304.312195:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.312212:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302304.312241:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789302304.312444:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399e29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c7a expref: 44 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.312479:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c7a expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.312489:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:1.0:1789302304.312492:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789302304.312496:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983e00, rc 0) 00000100:00100000:1.0:1789302304.312557:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+43:12270:x1876219101526912:12345-192.168.203.9@tcp:101:dd.0 Request processed in 11473us (11739us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789302304.312581:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 167 00000100:00100000:2.0:1789302304.319383:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302304.319462:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101527168 00000100:00100000:3.0:1789302304.319501:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101527168 00000100:00100000:3.0:1789302304.319582:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 168 00000100:00100000:3.0:1789302304.319594:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+43:12270:x1876219101527168:12345-192.168.203.9@tcp:101:dd.0 00010000:00010000:3.0:1789302304.319628:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302304.319828:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399e3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c81 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.319871:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399e45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.319888:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399e45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.319902:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399e45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.320062:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399e3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c81 expref: 45 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.320094:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399e45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c81 expref: 44 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.320106:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:3.0:1789302304.320109:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789302304.320304:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983c00, rc 0) 00000100:00100000:3.0:1789302304.320521:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+44:12270:x1876219101527168:12345-192.168.203.9@tcp:101:dd.0 Request processed in 927us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302304.320530:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 168 00000100:00100000:2.0:1789302304.325599:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302304.325726:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101527424 00000100:00100000:0.0:1789302304.325738:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101527424 00000100:00100000:0.0:1789302304.325807:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 169 00000100:00100000:0.0:1789302304.325818:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+44:12270:x1876219101527424:12345-192.168.203.9@tcp:36:dd.0 00010000:00010000:0.0:1789302304.326164:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.326186:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.326199:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302304.326249:0:10111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1789302304.326273:0:10111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e184c00f reply state 000000006f21c766 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.326287:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.326296:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:0.0:1789302304.326299:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789302304.326322:0:10111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789302304.326451:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+47:12270:x1876219101527424:12345-192.168.203.9@tcp:36:dd.0 Request processed in 633us (865us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789302304.326460:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 169 00000020:00080000:0.0:1789302304.326477:0:10111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789302304.340960:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121520896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789302304.341067:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302304.341207:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121520896 00000100:00100000:3.0:1789302304.341237:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121520896 00000100:00100000:3.0:1789302304.341315:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789302304.341328:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121520896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789302304.341367:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789302304.342968:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302304.342994:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121521024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302304.343065:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302304.343167:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121521024 00000100:00100000:1.0:1789302304.343174:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121521024 00000100:00100000:1.0:1789302304.343228:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789302304.343239:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121521024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302304.343263:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789302304.343310:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121521024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302304.343318:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789302304.343373:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121521024:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789302304.343398:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302304.346880:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121520896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5540us (5798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302304.346898:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789302304.347155:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121520896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302304.692033:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302304.692208:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101527552 00000100:00100000:3.0:1789302304.692221:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101527552 00000100:00100000:3.0:1789302304.692302:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 170 00000100:00100000:3.0:1789302304.692315:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+47:12285:x1876219101527552:12345-192.168.203.9@tcp:101:stat.0 00010000:00010000:3.0:1789302304.692347:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302304.692374:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399e53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c88 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.692480:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399e5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.692498:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399e5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.692512:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399e5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.692525:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399e61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.692533:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.692565:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.692667:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.692679:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c7a expref: 48 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.692688:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.692729:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c7a expref: 48 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.692745:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c7a expref: 48 pid: 6531 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302304.692762:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121521152:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302304.692900:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302304.706008:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302304.706218:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101527808 00000100:00100000:2.0:1789302304.706230:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101527808 00000100:00100000:2.0:1789302304.706331:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 43 00000100:00100000:2.0:1789302304.706343:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+49:6166:x1876219101527808:12345-192.168.203.9@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789302304.707050:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+50:6166:x1876219101527808:12345-192.168.203.9@tcp:35:ldlm_bl.0 Request processed in 705us (1051us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1789302304.707061:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 43 00000100:00100000:3.0:1789302304.707298:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121521152:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302304.707334:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302304.710313:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302304.714738:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101527936 00000100:00100000:2.0:1789302304.714758:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101527936 00010000:00010000:2.0:1789302304.714829:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c7a expref: 50 pid: 6531 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302304.714937:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 83 00000100:00100000:2.0:1789302304.714949:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+50:2398:x1876219101527936:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302304.714969:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302304.714987:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c7a expref: 50 pid: 6531 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.715004:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c7a expref: 50 pid: 6531 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.715033:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399e30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c7a expref: 50 pid: 6531 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.715054:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:2.0:1789302304.715060:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.715086:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.715191:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302304.715224:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302304.715305:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+49:2398:x1876219101527936:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 357us (5005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302304.715313:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 83 00010000:00010000:1.0:1789302304.719693:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.719718:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302304.719802:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789302304.719808:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302304.719851:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.719894:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.719907:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399e5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.719915:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399e5a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.719923:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399e5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.719930:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302304.719935:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399e5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.719945:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399e5a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.719964:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302304.719968:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302304.719974:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399e5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.719993:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399e5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.720016:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.720022:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399e61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.720035:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399e61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.720041:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302304.720044:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399e61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.720050:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399e61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.720059:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc381fa9600) 00010000:00010000:1.0:1789302304.720062:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302304.720065:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399e61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.720079:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399e61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.720178:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399e53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c88 expref: 49 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.720197:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c88 expref: 48 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302304.720205:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:1.0:1789302304.720207:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302304.720210:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982c00, rc 0) 00000100:00100000:1.0:1789302304.720305:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+48:12285:x1876219101527552:12345-192.168.203.9@tcp:101:stat.0 Request processed in 27992us (28286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302304.720326:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 170 00000100:00100000:1.0:1789302304.825871:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302304.826278:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101528192 00000100:00100000:3.0:1789302304.826292:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101528192 00000100:00100000:3.0:1789302304.826373:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 171 00000100:00100000:3.0:1789302304.826396:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38425df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+48:12291:x1876219101528192:12345-192.168.203.9@tcp:36:truncate.0 00010000:00010000:3.0:1789302304.826600:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302304.826696:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399e68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c88 expref: 48 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.826720:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:3.0:1789302304.826727:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302304.827029:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.827048:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.827060:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302304.829294:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:3.0:1789302304.829362:0:6530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000315a5aa7 reply state 000000003d299acd transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.829387:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.829397:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:3.0:1789302304.829400:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302304.829416:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302304.829578:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38425df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+50:12291:x1876219101528192:12345-192.168.203.9@tcp:36:truncate.0 Request processed in 3191us (3716us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789302304.829589:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 171 00000020:00080000:3.0:1789302304.829597:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1789302304.832908:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000004:00080000:2.0:1789302304.832952:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789302304.832979:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cc383a38180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789302304.832985:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc4aded5200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cc383a38d80 00000020:00080000:2.0:1789302304.832988:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc4aded5100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cc383b96400 00000020:00080000:2.0:1789302304.833054:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789302304.833166:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789302304.833495:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833510:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833519:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833527:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302304.833533:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833541:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833562:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cc383960500) 00010000:00010000:0.0:1789302304.833565:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302304.833572:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833578:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd399d03 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833610:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833616:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833652:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833658:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302304.833661:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833667:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833676:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:0.0:1789302304.833678:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302304.833682:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833688:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd399d0a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833706:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833713:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833718:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833723:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302304.833726:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833744:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833753:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc381fa9600) 00010000:00010000:0.0:1789302304.833755:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302304.833759:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833764:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399d49 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833780:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833787:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833793:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833799:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311ca00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302304.833801:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833808:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833816:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:0.0:1789302304.833819:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302304.833822:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.833838:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399e4c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302304.833859:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302304.833881:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121521280:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789302304.833963:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302304.834448:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121521280 00000100:00100000:3.0:1789302304.834476:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121521280 00000100:00100000:3.0:1789302304.834555:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789302304.834567:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121521280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789302304.834599:0:8446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1789302304.834645:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa6961e, atime: 0x6aa6961f, ctime: 0x6aa6961e, blocks: 0x8 00010000:00010000:3.0:1789302304.834653:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ada22175/0x1ff82925bd399e76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.834674:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1789302304.834680:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302304.834687:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ada22175/0x1ff82925bd399e76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.834707:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ada22175/0x1ff82925bd399e76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.834716:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ada22175/0x1ff82925bd399e76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.834723:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ada22175/0x1ff82925bd399e76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302304.834739:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789302304.834914:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121521280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 349us (950us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789302304.834922:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1789302304.836816:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302304.836835:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ada22175/0x1ff82925bd399e76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.836854:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983600 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302304.836860:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ada22175/0x1ff82925bd399e76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.836874:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ada22175/0x1ff82925bd399e76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.836903:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ada22175/0x1ff82925bd399e76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.836912:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ada22175/0x1ff82925bd399e76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302304.836948:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302304.836950:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302304.836952:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789302304.837023:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc381f7ea00/2, rc 0, transno 4294967308 00000100:00100000:0.0:1789302304.837055:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121521280:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789302305.048041:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302305.048228:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101528320 00000100:00100000:2.0:1789302305.048242:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101528320 00000100:00100000:2.0:1789302305.048317:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 172 00000100:00100000:2.0:1789302305.048329:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+18:12305:x1876219101528320:12345-192.168.203.9@tcp:101:stat.0 00010000:00010000:2.0:1789302305.048360:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302305.048401:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399e7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c8f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048505:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399e84 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048523:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399e84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048551:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399e84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048568:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399e8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048575:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399e8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048581:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399e8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048677:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048687:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048694:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302305.048750:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789302305.048755:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302305.048783:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048798:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048808:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399e84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048827:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399e84 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048834:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399e84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048842:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302305.048847:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399e84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048857:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399e84 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048872:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302305.048875:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302305.048882:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399e84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048888:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399e84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048907:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399e8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048913:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399e8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048920:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399e8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048925:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302305.048934:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399e8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048941:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399e8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048949:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc4c206f300) 00010000:00010000:2.0:1789302305.048952:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302305.048955:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399e8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048960:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd399e8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.048996:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399e7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c8f expref: 20 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.049011:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c8f expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.049019:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:2.0:1789302305.049021:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302305.049024:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348e00, rc 0) 00000100:00100000:2.0:1789302305.049187:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+19:12305:x1876219101528320:12345-192.168.203.9@tcp:101:stat.0 Request processed in 860us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302305.049196:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 172 00000100:00100000:2.0:1789302305.165330:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302305.165447:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101528576 00000100:00100000:1.0:1789302305.165461:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101528576 00000100:00100000:1.0:1789302305.165543:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 173 00000100:00100000:1.0:1789302305.165556:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+19:12315:x1876219101528576:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302305.165582:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302305.165609:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399e99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c96 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302305.165866:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789302305.166012:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399e99 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c96 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.166029:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc490721200) 00010000:00010000:1.0:1789302305.166032:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302305.166038:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c96 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.166057:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839ab000, rc 0) 00000100:00100000:1.0:1789302305.166242:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+20:12315:x1876219101528576:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 688us (927us total) trans 4294967448 rc 301/301 00000100:00100000:1.0:1789302305.166250:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 173 00000100:00100000:1.0:1789302305.169497:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302305.169603:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101528832 00000100:00100000:2.0:1789302305.169617:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101528832 00000100:00100000:2.0:1789302305.169691:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 44 00000100:00100000:2.0:1789302305.169724:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+20:12315:x1876219101528832:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:2.0:1789302305.170038:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912bbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+21:12315:x1876219101528832:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 315us (552us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789302305.170046:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 44 00010000:00010000:2.0:1789302305.175219:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302305.245216:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302305.246439:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101529088 00000100:00100000:3.0:1789302305.246457:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101529088 00000100:00100000:3.0:1789302305.246556:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 174 00000100:00100000:3.0:1789302305.246570:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+21:12321:x1876219101529088:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302305.246603:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302305.246631:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399ea7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5c9d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.246788:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.246806:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c8f expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.246818:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.246865:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c8f expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.246881:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c8f expref: 22 pid: 6532 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302305.246897:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f55880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6530:1876219121521408:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302305.247041:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302305.250564:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f55880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6530:1876219121521408:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302305.250605:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302305.252099:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302305.252376:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101529216 00000100:00100000:3.0:1789302305.252389:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101529216 00010000:00010000:3.0:1789302305.252440:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c8f expref: 23 pid: 6532 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302305.252487:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 84 00000100:00100000:3.0:1789302305.252501:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+23:2399:x1876219101529216:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302305.252521:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302305.252529:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c8f expref: 23 pid: 6532 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.252545:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c8f expref: 23 pid: 6532 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.252574:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399e92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c8f expref: 23 pid: 6532 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.252594:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:3.0:1789302305.252599:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.252612:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.252623:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.252664:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302305.252740:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+22:2399:x1876219101529216:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 241us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302305.252757:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 84 00010000:00010000:2.0:1789302305.252844:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.252856:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302305.252878:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789302305.254014:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399ea7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c9d expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.254039:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c9d expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.254048:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:2.0:1789302305.254051:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789302305.254055:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983600, rc 0) 00000100:00100000:2.0:1789302305.254770:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+22:12321:x1876219101529088:12345-192.168.203.9@tcp:101:bash.0 Request processed in 8199us (9566us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789302305.254783:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 174 00000100:00100000:1.0:1789302305.262383:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302305.262477:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101529472 00000100:00100000:3.0:1789302305.262490:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101529472 00000100:00100000:3.0:1789302305.262571:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 175 00000100:00100000:3.0:1789302305.262584:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+22:12321:x1876219101529472:12345-192.168.203.9@tcp:36:bash.0 00010000:00010000:3.0:1789302305.262898:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.262920:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.262933:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302305.262998:0:9541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:3.0:1789302305.263022:0:9541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035ec5b05 reply state 00000000c429920f transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.263036:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.263044:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:3.0:1789302305.263047:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302305.263052:0:9541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302305.263211:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+25:12321:x1876219101529472:12345-192.168.203.9@tcp:36:bash.0 Request processed in 628us (842us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789302305.263220:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 175 00000020:00080000:3.0:1789302305.263226:0:9541:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789302305.271858:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302305.272095:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101529600 00000100:00100000:3.0:1789302305.272110:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101529600 00000100:00100000:3.0:1789302305.272227:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 176 00000100:00100000:3.0:1789302305.272239:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+25:12321:x1876219101529600:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302305.272271:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302305.272300:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399ec3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ca4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.272451:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399eca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.272469:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c9d expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.272480:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399eca lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.272525:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c9d expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.272540:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c9d expref: 26 pid: 6530 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302305.272557:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f55880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121521536:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302305.272665:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302305.277245:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f55880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121521536:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302305.277288:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399eca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302305.277895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302305.278330:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101529728 00000100:00100000:3.0:1789302305.278340:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101529728 00010000:00010000:3.0:1789302305.278595:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c9d expref: 27 pid: 6530 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302305.278711:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 85 00000100:00100000:3.0:1789302305.278725:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+27:2399:x1876219101529728:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302305.278759:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302305.278768:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c9d expref: 27 pid: 6530 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.278782:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c9d expref: 27 pid: 6530 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.278810:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399eae lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c9d expref: 27 pid: 6530 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.278831:0:13201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:3.0:1789302305.278837:0:13201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399eca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.278850:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399eca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.278858:0:13201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399eca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.278897:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302305.279003:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+26:2399:x1876219101529728:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 281us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302305.279012:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 85 00010000:00010000:1.0:1789302305.279092:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399eca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.279103:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399eca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302305.279216:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789302305.279221:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302305.279248:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399eca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.279288:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399ec3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ca4 expref: 26 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.279305:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399eca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ca4 expref: 25 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.279312:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:1.0:1789302305.279314:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302305.279317:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982e00, rc 0) 00000100:00100000:1.0:1789302305.279362:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+25:12321:x1876219101529600:12345-192.168.203.9@tcp:101:bash.0 Request processed in 7125us (7520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302305.279371:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 176 00000100:00100000:1.0:1789302305.283290:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302305.283404:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101529984 00000100:00100000:2.0:1789302305.283417:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101529984 00000100:00100000:2.0:1789302305.283491:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 45 00000100:00100000:2.0:1789302305.283504:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+25:12321:x1876219101529984:12345-192.168.203.9@tcp:35:bash.0 00000100:00100000:2.0:1789302305.284026:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+26:12321:x1876219101529984:12345-192.168.203.9@tcp:35:bash.0 Request processed in 522us (749us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789302305.284034:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 45 00000100:00100000:2.0:1789302305.368261:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302305.368437:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101530240 00000100:00100000:3.0:1789302305.368451:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101530240 00000100:00100000:3.0:1789302305.368535:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 177 00000100:00100000:3.0:1789302305.368547:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+26:12331:x1876219101530240:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302305.368578:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302305.368606:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399ed1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cab expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302305.368761:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789302305.368890:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399ed1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cab expref: 28 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.368906:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc490721200) 00010000:00010000:3.0:1789302305.368909:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302305.368915:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399ed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cab expref: 28 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302305.368932:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983600, rc 0) 00000100:00100000:3.0:1789302305.370216:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+27:12331:x1876219101530240:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1659us (1960us total) trans 4294967454 rc 301/301 00000100:00100000:3.0:1789302305.370230:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 177 00000100:00100000:1.0:1789302305.382570:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302305.383046:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101530368 00000100:00100000:0.0:1789302305.383060:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101530368 00000100:00100000:0.0:1789302305.383192:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 178 00000100:00100000:0.0:1789302305.383207:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+27:12331:x1876219101530368:12345-192.168.203.9@tcp:34:lfs.0 00010000:00010000:0.0:1789302305.383312:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399edf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383334:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399edf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383349:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399edf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383368:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399ee6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383376:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383382:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383481:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd399eed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383491:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd399eed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383499:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd399eed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789302305.383574:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd399eed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383589:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399edf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383597:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399edf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383604:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399edf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383610:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311ca00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302305.383615:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399edf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383623:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399edf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383637:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:0.0:1789302305.383640:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302305.383645:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399edf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383651:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399edf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383664:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383671:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383682:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383687:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311d200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302305.383690:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383697:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383703:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc488eacd00) 00010000:00010000:0.0:1789302305.383705:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302305.383707:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399ee6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383712:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399ee6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383727:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd399eed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383733:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd399eed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383738:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd399eed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383741:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311d800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302305.383743:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd399eed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383757:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd399eed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383763:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:0.0:1789302305.383765:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302305.383767:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd399eed lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.383772:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd399eed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302305.383867:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+27:12331:x1876219101530368:12345-192.168.203.9@tcp:34:lfs.0 Request processed in 663us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302305.383875:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 178 00000100:00100000:1.0:1789302305.385986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302305.386093:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101530624 00000100:00100000:3.0:1789302305.386105:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101530624 00000100:00100000:2.0:1789302305.386587:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 46 00000100:00100000:2.0:1789302305.386603:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+27:12331:x1876219101530624:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:2.0:1789302305.386931:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+28:12331:x1876219101530624:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 333us (955us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789302305.386941:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 46 00000100:00100000:2.0:1789302305.427195:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302305.427420:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101530880 00000100:00100000:1.0:1789302305.427449:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101530880 00000100:00100000:1.0:1789302305.427518:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 179 00000100:00100000:1.0:1789302305.427529:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+28:12334:x1876219101530880:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302305.427561:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302305.427587:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399ef4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cb2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.427689:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399efb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.427707:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399efb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.427721:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399efb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.427738:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399f02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.427896:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399f02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.427904:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399f02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430021:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399f09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430050:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430073:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302305.430145:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789302305.430273:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399efb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430281:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399efb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430289:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399efb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430296:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302305.430301:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399efb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430309:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399efb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430324:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302305.430329:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302305.430334:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399efb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430341:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd399efb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430360:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399f02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430366:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399f02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430399:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399f02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430405:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302305.430408:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399f02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430414:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399f02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430423:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc383960700) 00010000:00010000:1.0:1789302305.430426:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302305.430429:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399f02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430434:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd399f02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430507:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399ef4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cb2 expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430525:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399f09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cb2 expref: 30 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.430533:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:1.0:1789302305.430535:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302305.430538:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aa200, rc 0) 00000100:00100000:1.0:1789302305.430941:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+30:12334:x1876219101530880:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 3410us (3757us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789302305.430963:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 179 00000100:00100000:3.0:1789302305.434339:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302305.434577:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101531008 00000100:00100000:1.0:1789302305.434590:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101531008 00000100:00100000:1.0:1789302305.434652:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 180 00000100:00100000:1.0:1789302305.434662:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+30:12334:x1876219101531008:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:1.0:1789302305.434755:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.434775:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.434787:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.434830:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.434838:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.434846:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.434854:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302305.434858:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.434865:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.434878:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:1.0:1789302305.434897:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302305.434904:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.434910:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302305.435222:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+30:12334:x1876219101531008:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 559us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302305.435231:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 180 00000100:00100000:3.0:1789302305.438611:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302305.439232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302305.439405:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101531136 00000100:00100000:2.0:1789302305.439418:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101531136 00000100:00100000:2.0:1789302305.439498:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00100000:2.0:1789302305.439511:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+30:2396:x1876219101531136:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302305.439531:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302305.439564:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd399f09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cb2 expref: 30 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.439590:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:2.0:1789302305.439596:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302305.439659:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+29:2396:x1876219101531136:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 152us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302305.439668:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00100000:0.0:1789302305.439869:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101531392 00000100:00100000:0.0:1789302305.439875:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101531392 00000100:00100000:0.0:1789302305.439916:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 47 00000100:00100000:0.0:1789302305.439924:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+29:12334:x1876219101531392:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:0.0:1789302305.440255:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+30:12334:x1876219101531392:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 331us (1024us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789302305.440263:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 47 00000100:00100000:3.0:1789302305.619809:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302305.620195:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101531648 00000100:00100000:0.0:1789302305.620210:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101531648 00000100:00100000:0.0:1789302305.620307:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 181 00000100:00100000:0.0:1789302305.620329:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+30:12352:x1876219101531648:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:0.0:1789302305.620874:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302305.621075:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399f1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cb9 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.621531:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399f25 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.621552:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399f25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.621568:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399f25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302305.621582:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789302305.621718:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399f1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cb9 expref: 33 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.624567:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399f25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cb9 expref: 32 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.624587:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:0.0:1789302305.624591:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789302305.624596:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311ca00, rc 0) 00000100:00100000:0.0:1789302305.624713:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+32:12352:x1876219101531648:12345-192.168.203.9@tcp:101:cat.0 Request processed in 4392us (4915us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789302305.624724:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 181 00000100:00100000:0.0:1789302305.655043:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302305.655201:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101531776 00000100:00100000:1.0:1789302305.655215:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101531776 00000100:00100000:1.0:1789302305.655284:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 182 00000100:00100000:1.0:1789302305.655298:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+32:12353:x1876219101531776:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302305.655343:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302305.655458:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cc0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.655541:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399f3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.655559:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.655573:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302305.655625:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789302305.655629:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302305.655649:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.655852:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc0 expref: 34 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.655878:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399f3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc0 expref: 33 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.655889:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302305.655892:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302305.655897:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aa400, rc 0) 00000100:00100000:1.0:1789302305.656177:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+33:12353:x1876219101531776:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 880us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302305.656185:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 182 00000100:00100000:3.0:1789302305.667350:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302305.675432:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101532160 00000100:00100000:0.0:1789302305.675452:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101532160 00000100:00100000:1.0:1789302305.692446:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 48 00000100:00100000:1.0:1789302305.692464:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+33:12353:x1876219101532160:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:1.0:1789302305.692897:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+34:12353:x1876219101532160:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 436us (25573us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789302305.692907:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 48 00000100:00100000:3.0:1789302305.695793:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302305.696108:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101532288 00000100:00100000:2.0:1789302305.696189:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101532288 00000100:00100000:2.0:1789302305.696287:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00100000:2.0:1789302305.696300:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+34:12353:x1876219101532288:12345-192.168.203.9@tcp:103:lfs.0 00010000:00010000:2.0:1789302305.696323:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789302305.696356:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399eca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ca4 expref: 34 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.696396:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ca00/0x1ff82925bd399f25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cb9 expref: 33 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.696412:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd399dc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c5e expref: 32 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302305.696424:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:2.0:1789302305.696431:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302305.696659:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+31:12353:x1876219101532288:12345-192.168.203.9@tcp:103:lfs.0 Request processed in 360us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302305.696667:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00100000:2.0:1789302305.718338:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302305.718846:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101532416 00000100:00100000:1.0:1789302305.718863:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101532416 00000100:00100000:1.0:1789302305.718943:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 183 00000100:00100000:1.0:1789302305.718964:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+31:12353:x1876219101532416:12345-192.168.203.9@tcp:58:lfs.0 00010000:00010000:1.0:1789302305.719175:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.719198:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302305.719231:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789302305.719365:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789302305.719480:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+31:12353:x1876219101532416:12345-192.168.203.9@tcp:58:lfs.0 Request processed in 525us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302305.719489:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 183 00000100:00100000:3.0:1789302305.775023:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302305.775172:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101532544 00000100:00100000:0.0:1789302305.775186:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101532544 00000100:00100000:0.0:1789302305.775285:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 184 00000100:00100000:0.0:1789302305.775316:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+31:12355:x1876219101532544:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1789302305.775343:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302305.775371:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399f48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cc7 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.775458:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd399f4f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.775477:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd399f4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.775492:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd399f4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.775510:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd399f56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.775518:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd399f56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.775526:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd399f56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776276:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776293:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776301:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302305.776373:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789302305.776378:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789302305.776401:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776418:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776428:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd399f4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776435:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd399f4f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776443:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd399f4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776450:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311ce00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302305.776455:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd399f4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776464:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd399f4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776478:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:0.0:1789302305.776481:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302305.776487:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd399f4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776493:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311ce00/0x1ff82925bd399f4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776520:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd399f56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776527:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd399f56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776675:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd399f56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776684:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311d400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302305.776688:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd399f56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776694:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd399f56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776703:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc488eacd00) 00010000:00010000:0.0:1789302305.776706:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302305.776709:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd399f56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776785:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd399f56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776897:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd399f48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc7 expref: 33 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776915:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc7 expref: 32 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302305.776936:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:0.0:1789302305.776939:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302305.776942:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311de00, rc 0) 00000100:00100000:1.0:1789302305.783144:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+32:12355:x1876219101532544:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 7791us (8096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302305.783161:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 184 00000100:00100000:1.0:1789302305.877335:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302305.877366:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121521664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302305.877465:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302305.877747:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121521664 00000100:00100000:0.0:1789302305.877758:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121521664 00000100:00100000:0.0:1789302305.877827:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789302305.877848:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121521664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789302305.877893:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789302305.877968:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121521664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302305.877977:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789302305.878036:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121521664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302305.883076:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121521792:0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.883172:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121521920:0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.883221:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302305.883253:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121522048:0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.883269:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121522432:0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.883288:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302305.883288:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302305.883305:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121522944:0@lo:400:kworker.0 00000100:00100000:2.0:1789302305.883306:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121522560:0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.883325:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302305.883329:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302305.883351:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121523072:0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.883367:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121521920 00000100:00100000:2.0:1789302305.883372:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302305.883375:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121521920 00000100:00100000:2.0:1789302305.883403:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121522048 00000100:00100000:2.0:1789302305.883409:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121522048 00000100:00100000:3.0:1789302305.883476:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121522432 00000100:00100000:3.0:1789302305.883480:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121522432 00000100:00100000:1.0:1789302305.883483:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302305.883507:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121522944 00000100:00100000:3.0:1789302305.883509:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121522944 00000100:00100000:1.0:1789302305.883513:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121522304:0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.883526:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789302305.883536:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121521920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302305.883548:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302305.883558:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121522816:0@lo:400:kworker.0 00000100:00100000:1.0:1789302305.883578:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302305.883589:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789302305.883594:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121522176:0@lo:400:kworker.0 00000100:00100000:1.0:1789302305.883626:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302305.883638:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121522688:0@lo:400:kworker.0 00000100:00100000:1.0:1789302305.883661:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302305.883677:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121523200:0@lo:400:kworker.0 00000100:00100000:1.0:1789302305.883708:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302305.883722:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121521920:12345-0@lo:400:kworker.0 Request processed in 186us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302305.883730:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789302305.883807:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121522304 00000100:00100000:3.0:1789302305.883867:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121522304 00000100:00100000:3.0:1789302305.883887:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121522816 00000100:00100000:3.0:1789302305.883889:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121522816 00000100:00100000:3.0:1789302305.883904:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121522176 00000100:00100000:3.0:1789302305.883906:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121522176 00000100:00100000:3.0:1789302305.883930:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789302305.883936:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121522432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.884021:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121522432:12345-0@lo:400:kworker.0 Request processed in 33us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302305.884029:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789302305.884043:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789302305.884049:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121522944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.884090:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121522944:12345-0@lo:400:kworker.0 Request processed in 41us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302305.884096:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789302305.884107:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789302305.884131:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121522304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.884158:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121522304:12345-0@lo:400:kworker.0 Request processed in 46us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302305.884164:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789302305.884175:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789302305.884180:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121522816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.884208:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121522816:12345-0@lo:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302305.884214:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789302305.884224:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789302305.884230:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121522176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.884253:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121522176:12345-0@lo:400:kworker.0 Request processed in 24us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302305.884258:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789302305.884287:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121521792 00000100:00100000:3.0:1789302305.884293:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121521792 00000100:00100000:3.0:1789302305.884319:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789302305.884325:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121521792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.884355:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121521792:12345-0@lo:400:kworker.0 Request processed in 31us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302305.884361:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789302305.885823:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789302305.885842:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121522048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302305.885914:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121522048:12345-0@lo:400:kworker.0 Request processed in 80us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302305.885921:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789302305.894286:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121522304:0@lo:400:kworker.0 00000100:00100000:1.0:1789302305.894313:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121522816:0@lo:400:kworker.0 00000100:00100000:1.0:1789302305.894339:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121521792:0@lo:400:kworker.0 00000100:00100000:1.0:1789302305.894377:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121522176:0@lo:400:kworker.0 00000100:00080000:1.0:1789302305.894434:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302305.894442:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789302305.895084:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121522560 00000100:00100000:3.0:1789302305.897099:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121523072 00000100:00100000:1.0:1789302305.897099:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121522688 00000100:00100000:3.0:1789302305.897128:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121523072 00000100:00100000:1.0:1789302305.897136:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121522688 00000100:00100000:2.0:1789302305.897187:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121522560 00000100:00100000:2.0:1789302305.897234:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789302305.897246:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121522688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302305.897262:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121523200 00000100:00100000:1.0:1789302305.897269:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121523200 00000100:00100000:3.0:1789302305.897280:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789302305.897293:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121523072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302305.897300:0:8852:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789302305.897311:0:8852:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1789302305.897367:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121523072:12345-0@lo:400:kworker.0 Request processed in 78us (13992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302305.897371:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121522688:12345-0@lo:400:kworker.0 Request processed in 125us (13705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302305.897381:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789302305.897677:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789302305.897695:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789302305.897703:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121522560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302305.897745:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121522560:12345-0@lo:400:kworker.0 Request processed in 43us (14413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302305.897751:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789302305.897765:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789302305.897773:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1876219121523200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302305.897807:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1876219121523200:12345-0@lo:400:kworker.0 Request processed in 36us (14099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302305.897814:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1789302305.897901:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302305.898152:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121522688:0@lo:400:kworker.0 00000100:00100000:1.0:1789302305.898172:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121523200:0@lo:400:kworker.0 00000100:00100000:3.0:1789302305.898332:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121521920:0@lo:400:kworker.0 00010000:00080000:3.0:1789302305.898352:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc3843eea00 x1876219121522432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302305.898364:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121522432:0@lo:400:kworker.0 00010000:00080000:3.0:1789302305.898377:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc3843ef480 x1876219121522944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302305.898452:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121522944:0@lo:400:kworker.0 00000100:00100000:2.0:1789302305.899333:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121522048:0@lo:400:kworker.0 00000100:00100000:2.0:1789302305.899351:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121522560:0@lo:400:kworker.0 00000100:00100000:2.0:1789302305.899365:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121523072:0@lo:400:kworker.0 00010000:00010000:3.0:1789302306.196362:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302306.397206:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121523328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302306.397308:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302306.397406:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121523328 00000100:00100000:1.0:1789302306.397416:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121523328 00000100:00100000:1.0:1789302306.397470:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789302306.397481:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121523328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302306.397520:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302306.397573:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121523328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302306.397602:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789302306.397660:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121523328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302306.403927:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121523456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302306.404019:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302306.406542:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121523456 00000100:00100000:1.0:1789302306.406561:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121523456 00000100:00100000:1.0:1789302306.406626:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789302306.406639:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121523456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302306.406674:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302306.406773:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121523456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (2754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302306.406781:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789302306.406869:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121523456:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789302306.452562:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302306.452580:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302306.452622:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789302306.452630:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789302306.452793:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121523584:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789302306.452912:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302306.473509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.473565:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101532672 00000100:00100000:2.0:1789302306.473577:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101532672 00000100:00100000:2.0:1789302306.473659:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 185 00000100:00100000:2.0:1789302306.473671:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+33:12366:x1876219101532672:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789302306.473710:0:9541:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789302306.474167:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+33:12366:x1876219101532672:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 496us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302306.474177:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 185 00000100:00080000:2.0:1789302306.474329:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302306.474453:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121523584:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789302306.492067:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302306.492984:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101532800 00000100:00100000:3.0:1789302306.493000:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101532800 00000100:00100000:3.0:1789302306.493100:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 186 00000100:00100000:3.0:1789302306.493134:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+32:12366:x1876219101532800:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789302306.493231:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399f64 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493253:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399f64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493267:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399f64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493285:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399f6b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493291:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399f6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493298:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399f6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493331:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399f72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493342:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399f72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493367:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399f72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302306.493438:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789302306.493443:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302306.493464:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399f72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493478:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399f64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493485:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399f64 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493492:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399f64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493498:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302306.493503:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399f64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493510:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399f64 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493523:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:3.0:1789302306.493526:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302306.493533:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399f64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493540:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd399f64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493567:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399f6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493573:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399f6b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493579:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399f6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493584:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302306.493588:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399f6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493594:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399f6b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493602:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8cc381fa9e00) 00010000:00010000:3.0:1789302306.493605:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302306.493608:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399f6b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493614:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd399f6b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493630:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399f72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493636:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399f72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493641:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399f72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493652:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302306.493656:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399f72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493661:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399f72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493668:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:3.0:1789302306.493670:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302306.493673:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399f72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.493679:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd399f72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302306.493971:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+32:12366:x1876219101532800:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 857us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302306.493981:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 186 00000100:00100000:2.0:1789302306.498393:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302306.498835:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101533056 00000100:00100000:3.0:1789302306.498849:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101533056 00000100:00100000:3.0:1789302306.499313:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 187 00000100:00100000:3.0:1789302306.499329:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+32:12366:x1876219101533056:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302306.499357:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302306.499385:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399f79 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cce expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.499532:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399f80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.499566:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399f80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.499581:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399f80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302306.499597:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789302306.499698:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399f80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.499706:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399f80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.499713:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399f80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.499721:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302306.499726:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399f80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.499734:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399f80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.499881:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:3.0:1789302306.499884:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302306.499891:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399f80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.499899:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399f80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.499953:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399f79 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cce expref: 34 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.499982:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:3.0:1789302306.499984:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302306.499989:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399f79 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cce expref: 34 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.500000:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982e00, rc 0) 00000100:00100000:3.0:1789302306.500100:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+33:12366:x1876219101533056:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 776us (1721us total) trans 4294967460 rc 301/301 00000100:00100000:3.0:1789302306.500108:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 187 00000100:00100000:2.0:1789302306.518032:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302306.521566:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101533184 00000100:00100000:3.0:1789302306.521588:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101533184 00000100:00100000:3.0:1789302306.521675:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 188 00000100:00100000:3.0:1789302306.521689:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+33:12366:x1876219101533184:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789302306.521738:0:10111:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789302306.521901:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+33:12366:x1876219101533184:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 214us (3881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302306.521910:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 188 00000100:00100000:3.0:1789302306.527277:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302306.527335:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101533440 00000100:00100000:3.0:1789302306.527348:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101533440 00000100:00100000:3.0:1789302306.527416:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 189 00000100:00100000:3.0:1789302306.527428:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+33:12366:x1876219101533440:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302306.527456:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302306.527460:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789302306.527495:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd399f3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc0 expref: 33 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.527545:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302306.527552:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302306.527570:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399f8e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789302306.528169:0:6530:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789302306.528352:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399f95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.528368:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399f95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.528380:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399f95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.528448:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd399f8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cd5 expref: 35 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.528468:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399f95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cd5 expref: 34 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.528477:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc381fa9b00) 00010000:00010000:3.0:1789302306.528479:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302306.528482:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4c2178600, rc 0) 00000100:00100000:3.0:1789302306.528555:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+34:12366:x1876219101533440:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1128us (1293us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789302306.528564:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 189 00000100:00100000:3.0:1789302306.544512:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302306.544553:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101533696 00000100:00100000:3.0:1789302306.544565:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101533696 00000100:00100000:3.0:1789302306.544634:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 190 00000100:00100000:3.0:1789302306.544646:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+34:12366:x1876219101533696:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789302306.546339:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302306.546393:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178600/0x1ff82925bd399f95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cd5 expref: 34 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546418:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc381fa9b00) 00010000:00010000:3.0:1789302306.546430:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302306.546465:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399fa3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546483:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546495:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546511:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399faa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x87e7d874 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546518:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399faa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e7d874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546523:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399faa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e7d874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546587:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546618:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399fa3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546624:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399fa3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546630:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302306.546636:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399fa3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546644:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399fa3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546653:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302306.546655:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302306.546659:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399fa3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546664:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178c00/0x1ff82925bd399fa3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546674:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399faa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e7d874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546680:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399faa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e7d874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546685:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399faa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e7d874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546689:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2179200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302306.546697:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399faa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e7d874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546703:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399faa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x87e7d874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546710:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x87e7d874 (ffff8cc381fa9400) 00010000:00010000:3.0:1789302306.546713:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302306.546715:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399faa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x87e7d874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.546721:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2179200/0x1ff82925bd399faa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x87e7d874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302306.548201:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+33:12366:x1876219101533696:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 3543us (3690us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302306.548216:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 190 00000100:00100000:1.0:1789302306.552407:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.553830:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101533824 00000100:00100000:2.0:1789302306.553846:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101533824 00000100:00100000:2.0:1789302306.553932:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 191 00000100:00100000:2.0:1789302306.553946:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+33:12366:x1876219101533824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302306.553982:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302306.554013:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399fb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cdc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.554071:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399fb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.554088:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.554105:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.554287:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd399fb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cdc expref: 35 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.554308:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cdc expref: 34 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.554317:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:2.0:1789302306.554320:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789302306.554325:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348600, rc 0) 00000100:00100000:2.0:1789302306.554409:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+34:12366:x1876219101533824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 466us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302306.554417:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 191 00000100:00100000:2.0:1789302306.565634:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302306.566479:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101534080 00000100:00100000:3.0:1789302306.566494:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101534080 00000100:00100000:3.0:1789302306.566598:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 192 00000100:00100000:3.0:1789302306.566611:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+34:12366:x1876219101534080:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789302306.566721:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.566753:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.566769:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302306.567010:0:9541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789302306.567042:0:9541:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382609928233ns, next at 383609925331ns, rc = 0 00000004:00010000:3.0:1789302306.567318:0:9541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078755263 reply state 00000000872949b2 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.567334:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.567343:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:3.0:1789302306.567346:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789302306.567352:0:9541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302306.567515:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+36:12366:x1876219101534080:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 905us (1894us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789302306.567523:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 192 00000100:00100000:2.0:1789302306.581703:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302306.581893:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101534208 00000100:00100000:3.0:1789302306.581906:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101534208 00000100:00100000:3.0:1789302306.581979:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 193 00000100:00100000:3.0:1789302306.581991:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+36:12366:x1876219101534208:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302306.582023:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302306.582048:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399fc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ce3 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.582162:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ce3 expref: 37 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.582179:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ce3 expref: 37 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.582201:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:3.0:1789302306.582205:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302306.582220:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982e00, rc 0) 00000100:00100000:3.0:1789302306.582300:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+37:12366:x1876219101534208:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 310us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302306.582308:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 193 00000100:00100000:3.0:1789302306.585357:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.585507:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101534336 00000100:00100000:2.0:1789302306.585519:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101534336 00000100:00100000:2.0:1789302306.585608:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 59 00000100:00100000:2.0:1789302306.585620:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+6:2399:x1876219101534336:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789302306.585911:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101534336:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 293us (567us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789302306.585919:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 59 00000100:00080000:3.0:1789302306.587234:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302306.598037:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302306.598171:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101534592 00000100:00100000:1.0:1789302306.598185:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101534592 00000100:00100000:1.0:1789302306.598255:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 49 00000100:00100000:1.0:1789302306.598268:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+37:12366:x1876219101534592:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789302306.598565:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+38:12366:x1876219101534592:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 298us (543us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1789302306.598574:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 49 00000100:00100000:2.0:1789302306.605175:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302306.605309:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101534848 00000100:00100000:1.0:1789302306.605324:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101534848 00000100:00100000:1.0:1789302306.605405:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 194 00000100:00100000:1.0:1789302306.605418:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+38:12366:x1876219101534848:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789302306.605553:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+38:12366:x1876219101534848:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 137us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302306.605577:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 194 00000100:00100000:3.0:1789302306.608658:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.608765:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101534976 00000100:00100000:2.0:1789302306.608779:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101534976 00000100:00100000:2.0:1789302306.608947:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 195 00000100:00100000:2.0:1789302306.608961:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+38:12366:x1876219101534976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302306.609012:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302306.609039:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399fcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cea expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.609175:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399fd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.609194:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.609208:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302306.609266:0:9541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302306.609293:0:9541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.609326:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399fcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cea expref: 40 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.609351:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cea expref: 39 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.609360:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:2.0:1789302306.609363:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789302306.609367:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348e00, rc 0) 00000100:00100000:2.0:1789302306.609435:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+39:12366:x1876219101534976:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 478us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302306.609442:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 195 00000100:00100000:0.0:1789302306.617868:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302306.618104:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101535104 00000100:00100000:3.0:1789302306.618141:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101535104 00000100:00100000:3.0:1789302306.618201:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:3.0:1789302306.618211:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101535104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302306.618233:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302306.618259:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399fdb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cf1 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302306.618290:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa69622, blocks: 0x0 00010000:00010000:3.0:1789302306.618315:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1789302306.618321:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302306.618331:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf1 expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.618351:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf1 expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.618367:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982c00, rc 0) 00000100:00100000:3.0:1789302306.618436:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdae6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101535104:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 227us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302306.618465:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:0.0:1789302306.626187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.626444:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101535360 00000100:00100000:2.0:1789302306.626458:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101535360 00000100:00100000:2.0:1789302306.626537:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 196 00000100:00100000:2.0:1789302306.626550:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+39:12366:x1876219101535360:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789302306.626693:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+39:12366:x1876219101535360:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 145us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302306.626701:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 196 00000100:00100000:0.0:1789302306.630766:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302306.630935:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101535488 00000100:00100000:1.0:1789302306.630947:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101535488 00000100:00100000:1.0:1789302306.631021:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:1.0:1789302306.631033:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+8:12366:x1876219101535488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302306.631066:0:14588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302306.631093:0:14588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cf8 expref: -99 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.631159:0:14588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399fdb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf1 expref: 9 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.631171:0:14588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302306.631176:0:14588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302306.631182:0:14588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 9 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.631226:0:14588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf1 expref: 9 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.631243:0:14588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399fdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf1 expref: 9 pid: 8446 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302306.631259:0:14588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14588:1876219121523712:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302306.631384:0:14588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383b08780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302306.633797:0:14588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14588:1876219121523712:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302306.634032:0:14588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 9 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.634065:0:14588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839abe00, rc 0) 00000100:00100000:1.0:1789302306.634326:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+9:12366:x1876219101535488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 3293us (3581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302306.634336:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:3.0:1789302306.636119:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302306.636308:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101535616 00000100:00100000:0.0:1789302306.636320:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101535616 00010000:00010000:0.0:1789302306.636372:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399fdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf1 expref: 9 pid: 8446 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302306.637052:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 86 00000100:00100000:0.0:1789302306.637075:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+9:2397:x1876219101535616:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302306.638780:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302306.638879:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399fdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf1 expref: 9 pid: 8446 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.638905:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399fdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf1 expref: 9 pid: 8446 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.638935:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd399fdb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf1 expref: 9 pid: 8446 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.638956:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302306.638961:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302306.638971:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 8 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.638982:0:13201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 8 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.639295:0:13201:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 8 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302306.639315:0:13201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13201:1876219121523840:192.168.203.9@tcp:105: 00000100:00100000:1.0:1789302306.639436:0:13201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383b08780 going to sleep for 11 seconds 00000100:00100000:3.0:1789302306.643343:0:13201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13201:1876219121523840:192.168.203.9@tcp:105: 00010000:00010000:3.0:1789302306.643379:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302306.643451:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+8:2397:x1876219101535616:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 6379us (7343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302306.643465:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 86 00000100:00100000:0.0:1789302306.646042:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.646419:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101535744 00000100:00100000:2.0:1789302306.646433:0:8450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101535744 00002000:00100000:2.0:1789302306.646507:0:8450:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8cc382916680 x1876219101535744/t0(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:637/0 lens 504/0 e 0 to 0 dl 1789302317 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302306.646520:0:8450:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc382916680 with x1876219101535744 ext(0->8) 00002000:00010000:2.0:1789302306.647685:0:8450:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc382916680 00000100:00100000:3.0:1789302306.648314:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4 00000100:00100000:3.0:1789302306.648339:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc382916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+8:2399:x1876219101535744:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789302306.650828:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc382916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+10:2399:x1876219101535744:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 2486us (4783us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789302306.650844:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4 00002000:00100000:3.0:1789302306.650860:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8cc382916680 x1876219101535744/t4294967315(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:637/0 lens 504/448 e 0 to 0 dl 1789302317 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789302306.650871:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc382916680 with x1876219101535744 ext(0->8) 00002000:00010000:3.0:1789302306.650879:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc382916680 00000100:00100000:0.0:1789302306.656529:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.656652:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101535872 00000100:00100000:2.0:1789302306.656667:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101535872 00000100:00100000:3.0:1789302306.656885:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 197 00000100:00100000:3.0:1789302306.656900:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+39:12366:x1876219101535872:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789302306.667721:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:3.0:1789302306.667752:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1789302306.667796:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1789302306.667991:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+22:12366:x1876219101535872:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 11088us (11468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302306.668017:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 197 00010000:00010000:0.0:1789302306.668504:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668519:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668527:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668543:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983a00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302306.668550:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668559:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668581:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:0.0:1789302306.668584:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302306.668591:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668599:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd399e6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668619:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668625:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668631:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668637:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302306.668640:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668647:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668667:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:0.0:1789302306.668670:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302306.668673:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668679:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd399ebc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668693:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668700:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668705:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668711:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302306.668714:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668720:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.668728:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:0.0:1789302306.668730:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000020:00080000:2.0:1789302306.669544:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789302306.669558:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789302306.669578:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b5281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121523968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789302306.669655:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302306.671660:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.671686:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178800/0x1ff82925bd399fbf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302306.671761:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121523968 00000100:00100000:0.0:1789302306.671773:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121523968 00000100:00100000:0.0:1789302306.671849:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789302306.671859:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121523968:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1789302306.680304:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789302306.680438:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789302306.680445:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789302306 00002000:00010000:0.0:1789302306.680449:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789302306.680451:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789302306 -> 1789302306 00002000:00010000:0.0:1789302306.680454:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789302306.680623:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121523968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 8759us (10961us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789302306.680635:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789302306.680725:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000004:00080000:3.0:1789302306.681002:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc4b5281880/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789302306.681010:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b5281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121523968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789302306.696250:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101536000 00000100:00100000:2.0:1789302306.696275:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101536000 00000100:00100000:2.0:1789302306.696840:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:2.0:1789302306.696857:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+10:2398:x1876219101536000:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789302306.709573:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1789302306.709594:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1789302306.709806:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101536000:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 12945us (29075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302306.709821:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:2.0:1789302306.729447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302306.729627:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101536256 00000100:00100000:3.0:1789302306.729640:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101536256 00000100:00100000:3.0:1789302306.729715:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 198 00000100:00100000:3.0:1789302306.729728:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+19:12366:x1876219101536256:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789302306.729802:0:10111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302306.729837:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd399fd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cea expref: 19 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.729863:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:3.0:1789302306.729869:0:10111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302306.729905:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.729921:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.729933:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302306.730147:0:10111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da2479fd reply state 00000000db6e8515 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.730179:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.730186:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:3.0:1789302306.730189:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302306.730192:0:10111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302306.730326:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+20:12366:x1876219101536256:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 600us (894us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1789302306.730334:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 198 00000100:00100000:1.0:1789302306.740274:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302306.740310:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101536384 00000100:00100000:0.0:1789302306.740322:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101536384 00000100:00100000:0.0:1789302306.740399:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 64 00000100:00100000:0.0:1789302306.740410:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101536384:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789302306.740605:0:14588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789302306.740610:0:14588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789302306 -> 1789302305 00002000:00010000:0.0:1789302306.740612:0:14588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789302303 00002000:00010000:0.0:1789302306.740614:0:14588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789302306 -> 1789302305 00002000:00010000:0.0:1789302306.740617:0:14588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789302306.740688:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+8:2399:x1876219101536384:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 279us (429us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789302306.740697:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 64 00000100:00100000:3.0:1789302306.747478:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.747576:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101536640 00000100:00100000:2.0:1789302306.747589:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101536640 00000100:00100000:2.0:1789302306.747669:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 199 00000100:00100000:2.0:1789302306.747682:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+20:12366:x1876219101536640:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789302306.747790:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.747812:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cdc expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.747824:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.747873:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cdc expref: 20 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.747890:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cdc expref: 20 pid: 6530 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302306.747907:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7fae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121524096:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302306.748021:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302306.755884:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302306.756002:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101536768 00000100:00100000:3.0:1789302306.756015:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101536768 00010000:00010000:3.0:1789302306.756074:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399fb8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cdc expref: 21 pid: 6530 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302306.756160:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 87 00000100:00100000:3.0:1789302306.756172:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+21:2399:x1876219101536768:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302306.756191:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302306.756200:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399fb8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cdc expref: 21 pid: 6530 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.756216:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cdc expref: 21 pid: 6530 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.756243:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:3.0:1789302306.756249:0:10408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.756275:0:10408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.756284:0:10408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.756311:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302306.756379:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+21:2399:x1876219101536768:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 208us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302306.756388:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 87 00010000:00010000:2.0:1789302306.756749:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd399fb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cdc expref: 20 pid: 6530 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302306.756769:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7fae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6531:1876219121524096:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302306.756797:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.756821:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.756828:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.756877:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.756885:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.756892:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.756898:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302306.756902:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.756910:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.756920:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:2.0:1789302306.756923:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789302306.756927:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.756933:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd399ff0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302306.756989:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+19:12366:x1876219101536640:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 9310us (9524us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789302306.757005:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 199 00000100:00100000:0.0:1789302306.772024:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.772094:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101536896 00000100:00100000:2.0:1789302306.772107:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101536896 00000100:00100000:2.0:1789302306.774231:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 65 00000100:00100000:2.0:1789302306.774256:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101536896:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789302306.774317:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.774342:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 8 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.774352:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302306.774357:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302306.774361:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.774404:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 8 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.774421:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 8 pid: 14588 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302306.774439:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7fae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121524224:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302306.774563:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302306.783861:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.784604:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7fae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121524224:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302306.784653:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302306.784869:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101537024 00000100:00100000:0.0:1789302306.784880:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101537024 00010000:00010000:0.0:1789302306.784928:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 9 pid: 14588 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302306.784984:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 88 00000100:00100000:0.0:1789302306.784995:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+9:2398:x1876219101537024:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302306.785012:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302306.785041:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 9 pid: 14588 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.785066:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 9 pid: 14588 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.785095:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae3f4b55/0x1ff82925bd399fe2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cf8 expref: 9 pid: 14588 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.785139:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302306.785145:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302306.785153:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.785164:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.785222:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302306.785295:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101537024:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 301us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302306.785304:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 88 00010000:00010000:3.0:1789302306.786278:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.786297:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.786329:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.786339:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.786347:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.786354:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302306.786359:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.786377:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.786626:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.786634:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c494502/0x1ff82925bd399ff7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302306.786717:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101536896:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 12469us (14705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302306.786728:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 65 00000100:00100000:3.0:1789302306.791289:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302306.792214:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101537280 00000100:00100000:0.0:1789302306.792230:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101537280 00000100:00100000:0.0:1789302306.792314:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 200 00000100:00100000:0.0:1789302306.792327:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+19:12366:x1876219101537280:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789302306.792515:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.792819:0:9541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399e45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c81 expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.792834:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.792883:0:9541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399e45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c81 expref: 19 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.792901:0:9541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399e45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c81 expref: 19 pid: 6530 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302306.792920:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4adc8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121524352:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302306.793035:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8300 going to sleep for 11 seconds 00000100:00100000:0.0:1789302306.795288:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302306.795302:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4adc8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121524352:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302306.795338:0:9541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302306.795456:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101537408 00000100:00100000:2.0:1789302306.795465:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101537408 00010000:00010000:2.0:1789302306.795514:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399e45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c81 expref: 20 pid: 6530 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302306.795556:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 89 00000100:00100000:2.0:1789302306.795566:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+20:2398:x1876219101537408:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302306.795584:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302306.795594:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399e45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c81 expref: 20 pid: 6530 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.795607:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399e45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c81 expref: 20 pid: 6530 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.795634:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd399e45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c81 expref: 20 pid: 6530 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.795651:0:13201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:2.0:1789302306.795656:0:13201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.795667:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.795676:0:13201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.795720:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302306.795785:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+19:2398:x1876219101537408:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 219us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302306.795793:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 89 00010000:00010000:0.0:1789302306.795872:0:9541:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.795881:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.796983:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.797006:0:9541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399fc6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ce3 expref: 19 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.797018:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.797071:0:9541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ce3 expref: 19 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302306.797088:0:9541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ce3 expref: 19 pid: 10111 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302306.797103:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121524480:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302306.797211:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302306.803176:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.805448:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101537536 00000100:00100000:2.0:1789302306.805469:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101537536 00010000:00010000:2.0:1789302306.805528:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399fc6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ce3 expref: 20 pid: 10111 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302306.805575:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 90 00000100:00100000:2.0:1789302306.805587:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+20:2398:x1876219101537536:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302306.805607:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302306.805615:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399fc6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ce3 expref: 20 pid: 10111 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.805629:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ce3 expref: 20 pid: 10111 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.805658:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:2.0:1789302306.805664:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.805676:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.805684:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.805723:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302306.805794:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+20:2398:x1876219101537536:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 209us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302306.805803:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 90 00010000:00010000:3.0:1789302306.806155:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd399fc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ce3 expref: 19 pid: 10111 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302306.806176:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121524480:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302306.806203:0:9541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.806213:0:9541:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.806242:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302306.806389:0:9541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1789302306.806539:0:9541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:3.0:1789302306.806582:0:9541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1789302306.806691:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9541:1876219121524608:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789302306.806759:0:9541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302306.806804:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383996a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302306.807724:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121524608 00000100:00100000:0.0:1789302306.807735:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121524608 00000100:00100000:0.0:1789302306.807804:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789302306.807814:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9541:x1876219121524608:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789302306.807933:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9541:x1876219121524608:12345-0@lo:1000:mdt00_003.0 Request processed in 120us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302306.807948:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789302306.809638:0:9541:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1789302306.809655:0:9541:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cc4b5281880, transno 4294967316 00000100:00100000:3.0:1789302306.809686:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9541:1876219121524608:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789302306.809885:0:9541:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:3.0:1789302306.810064:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9541:1876219121524736:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789302306.810162:0:9541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302306.810198:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3839969c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302306.810509:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121524736 00000100:00100000:3.0:1789302306.810518:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121524736 00000100:00100000:3.0:1789302306.810576:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789302306.810587:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9541:x1876219121524736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789302306.810739:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9541:x1876219121524736:12345-0@lo:1000:mdt00_003.0 Request processed in 154us (576us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789302306.810748:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789302306.810791:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9541:1876219121524736:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789302306.810836:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.810864:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.810873:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.810881:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311c800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302306.810886:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.810895:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.810915:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:3.0:1789302306.810918:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302306.810924:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.810932:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c800/0x1ff82925bd39a005 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812154:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812166:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f41 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812173:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812178:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302306.812190:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812200:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f41 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812215:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:3.0:1789302306.812217:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302306.812400:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f41 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812408:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd399f41 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812441:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812461:0:9541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc7 expref: 22 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812471:0:9541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812515:0:9541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc7 expref: 22 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.812533:0:9541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc7 expref: 22 pid: 10111 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302306.812549:0:9541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121524864:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302306.812643:0:9541:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3839969c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302306.825763:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302306.828400:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101537664 00000100:00100000:2.0:1789302306.828420:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101537664 00010000:00010000:2.0:1789302306.828485:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc7 expref: 23 pid: 10111 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302306.828533:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 91 00000100:00100000:2.0:1789302306.828545:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+23:2398:x1876219101537664:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302306.828565:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302306.828573:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc7 expref: 23 pid: 10111 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.828588:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc7 expref: 23 pid: 10111 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.828616:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:2.0:1789302306.828622:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.828635:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.828644:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302306.828689:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302306.828779:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+23:2398:x1876219101537664:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 235us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302306.828788:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 91 00010000:00010000:1.0:1789302306.834135:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311de00/0x1ff82925bd399f5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cc7 expref: 22 pid: 10111 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302306.834167:0:9541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9541:1876219121524864:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302306.834212:0:9541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834224:0:9541:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834231:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834265:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834273:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834281:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834288:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302306.834294:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834303:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834323:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:1.0:1789302306.834327:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302306.834332:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834339:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a00c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834352:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834357:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834362:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834795:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311d000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302306.834800:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834806:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834817:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc490721900) 00010000:00010000:1.0:1789302306.834819:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302306.834823:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.834829:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d000/0x1ff82925bd399ffe lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302306.835089:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+21:12366:x1876219101537280:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 42762us (43811us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789302306.835101:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 200 00000020:00080000:1.0:1789302306.835109:0:9541:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789302306.835163:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302306.835169:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302306.835657:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1789302306.835667:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789302306.838946:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302306.839037:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101537920 00000100:00100000:1.0:1789302306.839049:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101537920 00000100:00100000:1.0:1789302306.839154:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 50 00000100:00100000:1.0:1789302306.839165:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93f4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+21:12366:x1876219101537920:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789302306.839708:0:6533:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789302306.839751:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:1.0:1789302306.839793:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a013 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.839815:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a013 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.839840:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a013 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.839851:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a013 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.839858:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a013 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.839864:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a013 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302306.839893:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789302306.840008:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93f4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+23:12366:x1876219101537920:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 843us (1075us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789302306.840017:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 50 00000020:00080000:1.0:1789302306.840024:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789302306.841145:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302306.841167:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a013 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.841178:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aba00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302306.841184:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a013 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.841195:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a013 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.841214:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:3.0:1789302306.841218:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789302306.841234:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a013 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.841242:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a013 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302306.841256:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302306.841258:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302306.841259:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302306.901935:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121524992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302306.902061:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302306.902328:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121524992 00000100:00100000:2.0:1789302306.902339:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121524992 00000100:00100000:2.0:1789302306.902401:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789302306.902412:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121524992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302306.902452:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789302306.902516:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121524992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302306.902523:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789302306.902615:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121524992:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789302306.947396:0:14625:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302306.947410:0:14625:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302306.947443:0:14625:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789302306.947454:0:14625:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789302307.127086:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.127792:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101538176 00000100:00100000:3.0:1789302307.127805:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101538176 00000100:00100000:3.0:1789302307.127876:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 201 00000100:00100000:3.0:1789302307.127887:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+23:12376:x1876219101538176:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302307.127918:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302307.127944:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a01a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5cff expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.128094:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd39a021 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.128140:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd39a021 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.128158:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd39a021 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302307.128172:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789302307.128298:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a01a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cff expref: 26 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.128318:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd39a021 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cff expref: 25 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.128328:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302307.128331:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789302307.128335:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983e00, rc 0) 00000100:00100000:3.0:1789302307.128417:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+25:12376:x1876219101538176:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 531us (1342us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789302307.128425:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 201 00000100:00100000:2.0:1789302307.135609:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.135659:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101538304 00000100:00100000:2.0:1789302307.135672:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101538304 00000100:00100000:2.0:1789302307.135755:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 202 00000100:00100000:2.0:1789302307.135768:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+25:12376:x1876219101538304:12345-192.168.203.9@tcp:34:lfs.0 00010000:00010000:2.0:1789302307.135866:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a02f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.135889:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a02f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.135904:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a02f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.135922:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.135940:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.135947:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138393:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a03d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138421:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a03d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138434:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a03d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302307.138508:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a03d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138526:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a02f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138533:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a02f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138541:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a02f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138547:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302307.138552:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a02f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138560:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a02f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138584:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302307.138587:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302307.138594:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a02f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138601:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a02f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138616:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138622:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a036 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138629:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a036 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138635:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302307.138637:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a036 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138644:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a036 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138651:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc4adc10c00) 00010000:00010000:2.0:1789302307.138653:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302307.138656:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a036 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138663:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a036 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138812:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a03d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138819:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a03d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138825:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a03d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138830:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302307.138832:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a03d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138837:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a03d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138844:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc4adc10900) 00010000:00010000:2.0:1789302307.138847:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302307.138849:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a03d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.138855:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a03d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302307.139339:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+25:12376:x1876219101538304:12345-192.168.203.9@tcp:34:lfs.0 Request processed in 3190us (3363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302307.139351:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 202 00000100:00100000:2.0:1789302307.158169:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.158209:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.158234:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101538432 00000100:00100000:2.0:1789302307.158241:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.158256:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101538432 00000100:00100000:2.0:1789302307.158292:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.158312:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.158329:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 396 00000100:00100000:3.0:1789302307.158341:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101538432:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302307.158349:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.158375:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101538944 00000100:00100000:2.0:1789302307.158379:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101538944 00000100:00100000:3.0:1789302307.158429:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101538432:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 90us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302307.158437:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101538560 00000100:00100000:3.0:1789302307.158438:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 396 00000100:00100000:2.0:1789302307.158439:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101538560 00000100:00100000:2.0:1789302307.158457:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101539072 00000100:00100000:2.0:1789302307.158459:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101539072 00000100:00100000:2.0:1789302307.158475:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 349 00000100:00100000:3.0:1789302307.158480:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 350 00000100:00100000:2.0:1789302307.158482:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101538944:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302307.158486:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101538560:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302307.158518:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101538560:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302307.158524:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 350 00000100:00100000:3.0:1789302307.158550:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 351 00000100:00100000:3.0:1789302307.158557:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101539072:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302307.158875:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101538688 00000100:00100000:1.0:1789302307.158880:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101538688 00000100:00100000:1.0:1789302307.158912:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101538816 00000100:00100000:1.0:1789302307.158915:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101538816 00000100:00100000:1.0:1789302307.158941:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 165 00000100:00100000:1.0:1789302307.158948:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2396:x1876219101538688:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302307.160993:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 166 00000100:00100000:0.0:1789302307.161016:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+7:2396:x1876219101538816:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302307.161561:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101538944:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3074us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302307.161575:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 349 00000100:00080000:2.0:1789302307.161624:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302307.161632:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302307.161636:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302307.162311:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101539072:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 3735us (3942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302307.162324:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 351 00000100:00100000:1.0:1789302307.164616:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2396:x1876219101538688:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 5653us (6391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302307.164648:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 165 00000100:00100000:0.0:1789302307.173899:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+7:2396:x1876219101538816:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 12874us (15567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302307.173919:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 166 00000100:00100000:1.0:1789302307.183232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302307.183366:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101539328 00000100:00100000:1.0:1789302307.183377:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101539328 00000100:00100000:1.0:1789302307.183457:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 203 00000100:00100000:1.0:1789302307.183470:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+25:12379:x1876219101539328:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302307.183497:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302307.183524:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aac00/0x1ff82925bd39a044 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d06 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183620:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a04b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183639:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a04b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183654:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a04b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183672:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a052 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183679:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a052 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183687:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a052 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183831:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a059 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183849:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a059 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183856:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a059 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302307.183868:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789302307.183959:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a04b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183968:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a04b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183976:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a04b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183983:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302307.183988:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a04b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.183997:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a04b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184011:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302307.184014:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302307.184019:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a04b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184026:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a04b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184038:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a052 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184059:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a052 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184066:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a052 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184072:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302307.184075:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a052 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184082:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a052 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184090:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc383960700) 00010000:00010000:1.0:1789302307.184093:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302307.184096:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a052 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184102:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a052 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184179:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aac00/0x1ff82925bd39a044 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d06 expref: 28 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184196:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a059 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d06 expref: 27 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.184204:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:1.0:1789302307.184207:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302307.184215:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aba00, rc 0) 00000100:00100000:1.0:1789302307.184288:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+27:12379:x1876219101539328:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 820us (1069us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1789302307.184298:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 203 00000100:00100000:3.0:1789302307.190877:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.190923:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101539456 00000100:00100000:3.0:1789302307.190935:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101539456 00000100:00100000:3.0:1789302307.190999:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 204 00000100:00100000:3.0:1789302307.191012:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+27:12379:x1876219101539456:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:3.0:1789302307.191136:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a067 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.191156:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a067 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.191179:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a067 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.191227:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a067 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.191235:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a067 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.191242:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a067 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.191249:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302307.191255:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a067 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.191263:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a067 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.191279:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:3.0:1789302307.191282:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302307.191290:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a067 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.191297:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a067 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302307.191380:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+27:12379:x1876219101539456:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 371us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302307.191389:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 204 00000100:00100000:1.0:1789302307.194954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.195086:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101539712 00000100:00100000:3.0:1789302307.195107:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101539712 00000100:00100000:3.0:1789302307.195366:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 51 00000100:00100000:3.0:1789302307.195379:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+27:12379:x1876219101539712:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:3.0:1789302307.195658:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+28:12379:x1876219101539712:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 280us (716us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789302307.195667:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 51 00010000:00010000:2.0:1789302307.220308:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302307.241217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302307.241366:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101539968 00000100:00100000:0.0:1789302307.241383:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101539968 00000100:00100000:0.0:1789302307.241469:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 205 00000100:00100000:0.0:1789302307.241481:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+28:11911:x1876219101539968:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1789302307.241516:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302307.241544:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd39a06e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.241809:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.241828:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a059 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d06 expref: 29 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.241839:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.241904:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a059 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d06 expref: 29 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.241919:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a059 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d06 expref: 29 pid: 9541 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302307.241935:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6530:1876219121525120:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302307.243909:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302307.248523:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6530:1876219121525120:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302307.248566:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302307.248903:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.248967:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101540096 00000100:00100000:2.0:1789302307.248975:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101540096 00010000:00010000:2.0:1789302307.249025:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a059 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d06 expref: 30 pid: 9541 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302307.249076:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 92 00000100:00100000:2.0:1789302307.249086:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+30:2399:x1876219101540096:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302307.249104:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302307.249157:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a059 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d06 expref: 30 pid: 9541 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.249196:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a059 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d06 expref: 30 pid: 9541 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.249223:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39a059 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d06 expref: 30 pid: 9541 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.249241:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:2.0:1789302307.249253:0:10408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.249264:0:10408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.249273:0:10408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.249306:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302307.249351:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.249360:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302307.249364:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+29:2399:x1876219101540096:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 279us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302307.249372:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 92 00000004:00200000:3.0:1789302307.249395:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789302307.250223:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c200/0x1ff82925bd39a06e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d0d expref: 30 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.250249:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d0d expref: 29 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.250257:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:3.0:1789302307.250260:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789302307.250263:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311c000, rc 0) 00000100:00100000:2.0:1789302307.250385:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+29:11911:x1876219101539968:12345-192.168.203.9@tcp:101:bash.0 Request processed in 8906us (9181us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1789302307.250395:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 205 00000100:00100000:3.0:1789302307.254865:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302307.256292:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101540224 00000100:00100000:1.0:1789302307.256312:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101540224 00000100:00100000:1.0:1789302307.256405:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 206 00000100:00100000:1.0:1789302307.256418:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+29:11911:x1876219101540224:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1789302307.256451:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302307.256480:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a083 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d14 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.256539:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a08a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.256556:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a08a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.256570:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a08a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.256740:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a083 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d14 expref: 31 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.256763:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a08a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d14 expref: 30 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.256772:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:1.0:1789302307.256783:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302307.256788:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839abc00, rc 0) 00000100:00100000:1.0:1789302307.256875:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+30:11911:x1876219101540224:12345-192.168.203.9@tcp:101:bash.0 Request processed in 459us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302307.256882:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 206 00000100:00100000:0.0:1789302307.260362:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.260457:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101540480 00000100:00100000:3.0:1789302307.260471:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101540480 00000100:00100000:3.0:1789302307.260547:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 207 00000100:00100000:3.0:1789302307.260559:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+30:11911:x1876219101540480:12345-192.168.203.9@tcp:36:bash.0 00010000:00010000:3.0:1789302307.261075:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.261097:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.261153:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302307.261208:0:10111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1789302307.261235:0:10111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f40e9dc2 reply state 0000000048a37c9d transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.261250:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.261258:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:3.0:1789302307.261262:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302307.261267:0:10111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789302307.261313:0:10111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1789302307.261436:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+34:11911:x1876219101540480:12345-192.168.203.9@tcp:36:bash.0 Request processed in 877us (1087us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789302307.261445:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 207 00000020:00080000:3.0:1789302307.261452:0:10111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789302307.274792:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302307.274980:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101540608 00000100:00100000:0.0:1789302307.274994:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101540608 00000100:00100000:0.0:1789302307.275076:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 208 00000100:00100000:0.0:1789302307.275089:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+34:11911:x1876219101540608:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1789302307.275168:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302307.275197:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39a098 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.275274:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39a098 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d1b expref: 35 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.275292:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39a098 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d1b expref: 35 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.275314:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:0.0:1789302307.275317:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302307.275321:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311d800, rc 0) 00000100:00100000:0.0:1789302307.275416:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+35:11911:x1876219101540608:12345-192.168.203.9@tcp:101:bash.0 Request processed in 328us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302307.275424:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 208 00000100:00100000:0.0:1789302307.280405:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.280643:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101540736 00000100:00100000:3.0:1789302307.280657:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101540736 00000100:00100000:3.0:1789302307.280848:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 66 00000100:00100000:3.0:1789302307.280862:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b5281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:11911:x1876219101540736:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302307.280886:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302307.280915:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ada22175/0x1ff82925bd39a09f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d22 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302307.280954:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa69621, atime: 0x6aa6961f, ctime: 0x6aa69621, blocks: 0x8 00010000:00010000:3.0:1789302307.280994:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1789302307.281000:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302307.281010:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ada22175/0x1ff82925bd39a09f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d22 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.281029:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ada22175/0x1ff82925bd39a09f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d22 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.281044:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983600, rc 0) 00000100:00100000:3.0:1789302307.281156:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b5281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+8:11911:x1876219101540736:12345-192.168.203.9@tcp:101:bash.0 Request processed in 297us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302307.281164:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 66 00000100:00100000:0.0:1789302307.284297:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302307.284410:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101540864 00000100:00100000:1.0:1789302307.284423:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101540864 00002000:00010000:1.0:1789302307.284473:0:8451:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1789302307.284479:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4a7f09c00 with x1876219101540864 ext(0->18446744073709551615) 00002000:00010000:1.0:1789302307.284494:0:8451:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc4a7f09c00. 00000100:00100000:1.0:1789302307.284697:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5 00000100:00100000:1.0:1789302307.284710:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101540864:12345-192.168.203.9@tcp:10:bash.0 00002000:00010000:1.0:1789302307.285090:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789302307.285094:0:8451:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789302305 -> 1789302307 00002000:00010000:1.0:1789302307.285097:0:8451:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789302303 -> 1789302303 00002000:00010000:1.0:1789302307.285099:0:8451:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789302305 -> 1789302307 00002000:00010000:1.0:1789302307.285101:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789302307.285250:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c76ee310-c3b4-4286-aaea-77936c269d98+9:2398:x1876219101540864:12345-192.168.203.9@tcp:10:bash.0 Request processed in 541us (966us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789302307.285259:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5 00002000:00010000:1.0:1789302307.285263:0:8451:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1789302307.285267:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4a7f09c00 with x1876219101540864 ext(0->18446744073709551615) 00002000:00010000:1.0:1789302307.285274:0:8451:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc4a7f09c00. 00000100:00100000:2.0:1789302307.369951:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.370076:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101540992 00000100:00100000:3.0:1789302307.370090:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101540992 00000100:00100000:3.0:1789302307.370210:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 209 00000100:00100000:3.0:1789302307.370224:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+35:12393:x1876219101540992:12345-192.168.203.9@tcp:34:lfs.0 00010000:00010000:3.0:1789302307.370323:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a0a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370344:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370377:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370396:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a0ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370404:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a0ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370411:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a0ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370513:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370525:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370532:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302307.370665:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370681:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370688:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a0a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370695:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370713:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302307.370719:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370729:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a0a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370913:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302307.370916:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302307.370923:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a0a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370930:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a0a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370947:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a0ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370953:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a0ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370959:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a0ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370965:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302307.370968:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a0ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370975:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a0ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.370994:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc381fa9100) 00010000:00010000:3.0:1789302307.370997:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302307.371000:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a0ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.371006:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a0ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.371023:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.371029:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.371035:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.371040:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302307.371044:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.371059:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.371067:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:3.0:1789302307.371069:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302307.371073:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.371078:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302307.371249:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+35:12393:x1876219101540992:12345-192.168.203.9@tcp:34:lfs.0 Request processed in 1026us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302307.371259:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 209 00000100:00100000:0.0:1789302307.412887:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302307.412999:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101541248 00000100:00100000:1.0:1789302307.413011:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101541248 00000100:00100000:1.0:1789302307.413087:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 210 00000100:00100000:1.0:1789302307.413099:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+35:12396:x1876219101541248:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302307.413206:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302307.413234:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abe00/0x1ff82925bd39a0bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d29 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413333:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a0c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413351:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a0c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413365:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a0c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413384:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a0c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413393:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413400:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413713:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a0d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413725:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413734:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302307.413747:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789302307.413854:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a0c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413862:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a0c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413869:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a0c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413875:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302307.413881:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a0c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413889:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a0c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413904:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302307.413908:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302307.413914:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a0c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413920:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a0c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413937:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413944:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a0c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413951:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413956:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302307.413966:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413972:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a0c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413979:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc383960700) 00010000:00010000:1.0:1789302307.413982:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302307.413984:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a0c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.413990:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a0c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.414042:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abe00/0x1ff82925bd39a0bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d29 expref: 38 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.414068:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d29 expref: 37 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.414076:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:1.0:1789302307.414078:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789302307.414081:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aaa00, rc 0) 00000100:00100000:1.0:1789302307.414258:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+37:12396:x1876219101541248:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1161us (1384us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789302307.414266:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 210 00000100:00100000:1.0:1789302307.417200:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.419096:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101541376 00000100:00100000:3.0:1789302307.419126:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101541376 00000100:00100000:3.0:1789302307.419217:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 211 00000100:00100000:3.0:1789302307.419229:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+37:12396:x1876219101541376:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:3.0:1789302307.419321:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.419343:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d0d expref: 37 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.419355:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.419744:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d0d expref: 37 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.419763:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d0d expref: 37 pid: 6530 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302307.419780:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6532:1876219121525248:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302307.419906:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3839963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302307.432104:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302307.432158:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101541632 00000100:00100000:1.0:1789302307.432171:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101541632 00000100:00100000:3.0:1789302307.432253:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f19500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6532:1876219121525248:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302307.432289:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302307.432406:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:0.0:1789302307.432419:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+38:6634:x1876219101541632:12345-192.168.203.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789302307.432807:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+39:6634:x1876219101541632:12345-192.168.203.9@tcp:35:ldlm_bl.0 Request processed in 388us (716us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789302307.432816:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:0.0:1789302307.437404:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.437886:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101541760 00000100:00100000:3.0:1789302307.437899:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101541760 00010000:00010000:3.0:1789302307.437955:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d0d expref: 39 pid: 6530 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302307.438209:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 93 00000100:00100000:3.0:1789302307.438221:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+39:2398:x1876219101541760:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302307.438242:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302307.438251:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d0d expref: 39 pid: 6530 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.438265:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d0d expref: 39 pid: 6530 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.438293:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311c000/0x1ff82925bd39a075 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d0d expref: 39 pid: 6530 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.438310:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:3.0:1789302307.438316:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.438327:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.438335:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.438374:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302307.438408:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.438417:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302307.438456:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+38:2398:x1876219101541760:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 236us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302307.438463:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 93 00010000:00010000:1.0:1789302307.438474:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.438482:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.438489:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.438496:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302307.438502:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.438519:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.438531:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:1.0:1789302307.438533:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302307.438537:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.438543:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a0de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302307.438585:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+37:12396:x1876219101541376:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 19358us (21399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302307.438593:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 211 00000100:00100000:1.0:1789302307.444595:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302307.444763:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101542016 00000100:00100000:0.0:1789302307.444776:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101542016 00000100:00100000:0.0:1789302307.444846:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 53 00000100:00100000:0.0:1789302307.444859:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+37:12396:x1876219101542016:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:0.0:1789302307.445202:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+38:12396:x1876219101542016:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 346us (633us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789302307.445211:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 53 00000100:00100000:0.0:1789302307.542018:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.542167:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101542272 00000100:00100000:2.0:1789302307.542181:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101542272 00000100:00100000:2.0:1789302307.542259:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 212 00000100:00100000:2.0:1789302307.542293:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+38:12407:x1876219101542272:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:2.0:1789302307.542329:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302307.542356:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a0e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d30 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542454:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a0ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542472:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a0ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542486:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a0ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542502:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a0f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542510:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542517:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542665:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a0fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542675:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a0fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542684:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a0fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302307.542707:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789302307.542812:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a0ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542821:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a0ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542829:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a0ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542835:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302307.542840:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a0ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542849:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a0ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542864:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302307.542868:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302307.542874:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a0ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542881:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a0ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542899:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542906:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a0f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542924:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542930:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302307.542932:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542938:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542948:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc4adc10900) 00010000:00010000:2.0:1789302307.542951:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302307.542954:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a0f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.542960:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a0f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.543010:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a0e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d30 expref: 41 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.543027:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a0fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d30 expref: 40 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.543033:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:2.0:1789302307.543035:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302307.543038:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349c00, rc 0) 00000100:00100000:2.0:1789302307.543185:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+40:12407:x1876219101542272:12345-192.168.203.9@tcp:101:cat.0 Request processed in 897us (1182us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789302307.543202:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 212 00000100:00100000:1.0:1789302307.550544:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302307.550871:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101542528 00000100:00100000:0.0:1789302307.550885:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101542528 00000100:00100000:0.0:1789302307.550974:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 54 00000100:00100000:0.0:1789302307.550987:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+40:12407:x1876219101542528:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:0.0:1789302307.551430:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+41:12407:x1876219101542528:12345-192.168.203.9@tcp:35:cat.0 Request processed in 444us (912us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789302307.551458:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 54 00000100:00100000:0.0:1789302307.569500:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.570099:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101542784 00000100:00100000:2.0:1789302307.570151:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101542784 00000100:00100000:2.0:1789302307.570274:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 213 00000100:00100000:2.0:1789302307.570287:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+41:12408:x1876219101542784:12345-192.168.203.9@tcp:36:rm.0 00010000:00010000:2.0:1789302307.570366:0:6530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789302307.570419:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39a098 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d1b expref: 41 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570448:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a0fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d30 expref: 40 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570462:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a0d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d29 expref: 39 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570476:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a08a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d14 expref: 38 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570487:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:2.0:1789302307.570493:0:6530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302307.570692:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a108 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570712:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a108 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570725:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a108 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570778:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570786:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570794:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570900:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a116 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570911:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a116 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.570918:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a116 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302307.571274:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1789302307.571286:0:6530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383614172916ns, next at 384614169746ns, rc = 0 00010000:00010000:2.0:1789302307.571345:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a11d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571354:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a11d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571362:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a11d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571370:0:6530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a11d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571402:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a11d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571408:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a11d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571442:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789302307.571468:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a116 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571473:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a116 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571480:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a116 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571485:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302307.571490:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a116 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571498:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a116 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571508:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:2.0:1789302307.571511:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789302307.571515:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a116 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571534:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a116 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571556:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a108 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571568:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a108 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571574:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a108 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571579:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302307.571582:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a108 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571589:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a108 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571598:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302307.571600:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302307.571603:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a108 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571609:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a108 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302307.571620:0:6530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca8c8ec1 reply state 000000003efbc991 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571632:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.571638:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc4adc10900) 00010000:00010000:2.0:1789302307.571641:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789302307.571644:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302307.571743:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+39:12408:x1876219101542784:12345-192.168.203.9@tcp:36:rm.0 Request processed in 1455us (2256us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789302307.571758:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 213 00010000:00010000:1.0:1789302307.571857:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302307.571866:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a11d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.571873:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349e00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302307.571876:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a11d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.571882:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a11d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.571891:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:1.0:1789302307.571894:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789302307.571897:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a11d lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.571903:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a11d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.571915:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302307.571917:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302307.571919:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302307.640909:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.641014:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101543040 00000100:00100000:3.0:1789302307.641028:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101543040 00000100:00100000:3.0:1789302307.641153:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 214 00000100:00100000:3.0:1789302307.641165:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+39:12414:x1876219101543040:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302307.641198:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302307.641227:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a124 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.641367:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a12b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.641386:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a12b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.641400:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a12b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.641412:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.641420:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.641426:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789302307.641940:0:6532:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789302307.642173:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a139 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642207:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a139 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642217:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a139 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642261:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a12b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642268:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a12b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642276:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a12b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642282:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302307.642287:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a12b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642295:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a12b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642309:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302307.642313:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302307.642319:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a12b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642325:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a12b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302307.642342:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b585c01 reply state 000000009cae0e0e transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642363:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642369:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc4adc10900) 00010000:00010000:3.0:1789302307.642371:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302307.642375:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789302307.642417:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a124 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d37 expref: 42 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642432:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a139 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d37 expref: 41 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.642440:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:3.0:1789302307.642443:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302307.642446:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982c00, rc 0) 00000100:00100000:3.0:1789302307.643031:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+42:12414:x1876219101543040:12345-192.168.203.9@tcp:101:bash.0 Request processed in 1363us (1631us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789302307.643041:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 214 00000100:00100000:1.0:1789302307.648323:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.650679:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101543168 00000100:00100000:2.0:1789302307.650699:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101543168 00000100:00100000:2.0:1789302307.650864:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 67 00000100:00100000:2.0:1789302307.650877:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101543168:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1789302307.650899:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302307.650926:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a147 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d3e expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302307.650968:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789302307.650994:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1789302307.650999:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302307.651010:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a147 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d3e expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.651030:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a147 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d3e expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.651045:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349200, rc 0) 00000100:00100000:2.0:1789302307.651171:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101543168:12345-192.168.203.9@tcp:101:bash.0 Request processed in 295us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302307.651178:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 67 00000100:00100000:0.0:1789302307.655552:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.655629:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101543296 00000100:00100000:2.0:1789302307.655643:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101543296 00000100:00100000:2.0:1789302307.655715:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 68 00000100:00100000:2.0:1789302307.655728:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+8:12414:x1876219101543296:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1789302307.655771:0:14588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302307.655796:0:14588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d45 expref: -99 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.655837:0:14588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a147 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d3e expref: 9 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.655847:0:14588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302307.655852:0:14588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302307.655858:0:14588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 9 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.655897:0:14588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a147 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d3e expref: 9 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.655912:0:14588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a147 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d3e expref: 9 pid: 8446 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302307.655930:0:14588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14588:1876219121525376:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302307.656068:0:14588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302307.659452:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302307.659545:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101543424 00000100:00100000:1.0:1789302307.659558:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101543424 00010000:00010000:1.0:1789302307.659615:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a147 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d3e expref: 10 pid: 8446 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302307.659674:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 94 00000100:00100000:1.0:1789302307.659704:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+10:2398:x1876219101543424:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302307.659724:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302307.659756:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a147 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d3e expref: 10 pid: 8446 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.659771:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a147 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d3e expref: 10 pid: 8446 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.659803:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302307.659809:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302307.659819:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 10 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.659831:0:13201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 10 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.659880:0:13201:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 10 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302307.659898:0:13201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7f57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13201:1876219121525504:192.168.203.9@tcp:105: 00000100:00100000:1.0:1789302307.660002:0:13201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49a5d5f00 going to sleep for 11 seconds 00010000:00010000:2.0:1789302307.660277:0:14588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a147 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d3e expref: 10 pid: 8446 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302307.660296:0:14588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14588:1876219121525376:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302307.660327:0:14588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 9 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.660347:0:14588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349000, rc 0) 00000100:00100000:2.0:1789302307.660831:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+9:12414:x1876219101543296:12345-192.168.203.9@tcp:101:bash.0 Request processed in 4657us (4844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302307.660843:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 68 00000100:00100000:0.0:1789302307.665887:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.666541:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101543680 00000100:00100000:2.0:1789302307.666554:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101543680 00000100:00100000:2.0:1789302307.666629:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 55 00000100:00100000:2.0:1789302307.666642:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+42:12414:x1876219101543680:12345-192.168.203.9@tcp:35:bash.0 00000100:00100000:1.0:1789302307.666658:0:13201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7f57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13201:1876219121525504:192.168.203.9@tcp:105: 00010000:00010000:1.0:1789302307.666687:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302307.666810:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101543424:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 7107us (7374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302307.666840:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 94 00000100:00100000:2.0:1789302307.666975:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+43:12414:x1876219101543680:12345-192.168.203.9@tcp:35:bash.0 Request processed in 335us (1100us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789302307.666982:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 55 00000100:00100000:1.0:1789302307.891446:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.891560:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101543808 00000100:00100000:2.0:1789302307.891574:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101543808 00000100:00100000:2.0:1789302307.891649:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 215 00000100:00100000:2.0:1789302307.891662:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+43:12431:x1876219101543808:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302307.891697:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302307.891724:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a155 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d4c expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.891812:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a15c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.891830:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a15c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.891844:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a15c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302307.891913:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789302307.891916:0:9541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302307.891938:0:9541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a15c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.891965:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d4c expref: 45 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.891988:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a15c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d4c expref: 44 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.891998:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302307.892001:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302307.892006:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349c00, rc 0) 00000100:00100000:2.0:1789302307.892088:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+44:12431:x1876219101543808:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 429us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302307.892095:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 215 00000100:00100000:0.0:1789302307.901086:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.901231:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101544064 00000100:00100000:2.0:1789302307.901244:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101544064 00000100:00100000:2.0:1789302307.901334:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 216 00000100:00100000:2.0:1789302307.901347:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+44:12431:x1876219101544064:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302307.901374:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302307.901409:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a163 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d53 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.901755:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a16a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.901794:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a16a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.901808:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a16a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302307.901824:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789302307.901961:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a163 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d53 expref: 47 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.901986:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a16a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d53 expref: 46 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.901997:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:2.0:1789302307.902000:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302307.902005:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348000, rc 0) 00000100:00100000:2.0:1789302307.902211:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+46:12431:x1876219101544064:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 866us (1139us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1789302307.902221:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 216 00000100:00100000:1.0:1789302307.919489:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302307.922890:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302307.923643:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101544448 00000100:00100000:0.0:1789302307.923659:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101544448 00000100:00100000:0.0:1789302307.923751:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00100000:0.0:1789302307.923762:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+46:2396:x1876219101544448:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302307.923782:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302307.923813:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a16a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d53 expref: 46 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.923839:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:0.0:1789302307.923845:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302307.923916:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+45:2396:x1876219101544448:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 156us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302307.923924:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00100000:2.0:1789302307.930469:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101544320 00000100:00100000:2.0:1789302307.930489:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101544320 00000100:00100000:2.0:1789302307.931254:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 217 00000100:00100000:2.0:1789302307.931268:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+45:12431:x1876219101544320:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302307.931307:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302307.931334:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a178 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d5a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.931498:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a17f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.931533:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a17f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.931548:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a17f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302307.931564:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789302307.931694:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a178 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d5a expref: 48 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.931716:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a17f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d5a expref: 47 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.931726:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:2.0:1789302307.931729:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789302307.931733:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348e00, rc 0) 00000100:00100000:2.0:1789302307.931813:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+47:12431:x1876219101544320:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 549us (12341us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1789302307.931821:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 217 00000100:00100000:3.0:1789302307.939600:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302307.939722:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101544576 00000100:00100000:0.0:1789302307.939740:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101544576 00000100:00100000:0.0:1789302307.939799:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 69 00000100:00100000:0.0:1789302307.939814:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101544576:12345-192.168.203.9@tcp:1:lfs.0 00010000:00010000:0.0:1789302307.939859:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.939897:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 8 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.939906:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302307.939910:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302307.939915:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.939950:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 8 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.940100:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 8 pid: 14588 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302307.940187:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383807480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1876219121525632:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302307.940308:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789302307.947544:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302307.947610:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383807480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1876219121525632:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302307.947633:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101544704 00010000:00010000:3.0:1789302307.947645:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302307.947646:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101544704 00002000:00100000:2.0:1789302307.947717:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8cc4b7f55180 x1876219101544704/t0(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:638/0 lens 504/0 e 0 to 0 dl 1789302318 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302307.947729:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4b7f55180 with x1876219101544704 ext(0->8) 00010000:00010000:2.0:1789302307.947758:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 9 pid: 14588 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.947777:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 9 pid: 14588 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302307.947785:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cc4b7f55180 00000100:00100000:2.0:1789302307.947831:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:2.0:1789302307.947842:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+9:2399:x1876219101544704:12345-192.168.203.9@tcp:4:lfs.0 00000100:00100000:2.0:1789302307.953628:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+11:2399:x1876219101544704:12345-192.168.203.9@tcp:4:lfs.0 Request processed in 5768us (6088us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789302307.953650:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3 00002000:00100000:2.0:1789302307.953670:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8cc4b7f55180 x1876219101544704/t4294967309(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:638/0 lens 504/448 e 0 to 0 dl 1789302318 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302307.953682:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc4b7f55180 with x1876219101544704 ext(0->8) 00010000:00010000:2.0:1789302307.953696:0:8452:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 11 pid: 14588 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.953722:0:8452:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 11 pid: 14588 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302307.953731:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cc4b7f55180 00000100:00100000:3.0:1789302307.960194:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.960379:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101544832 00000100:00100000:2.0:1789302307.960392:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101544832 00010000:00010000:2.0:1789302307.960446:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 11 pid: 14588 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302307.960528:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 95 00000100:00100000:2.0:1789302307.960541:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+11:2396:x1876219101544832:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302307.960562:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789302307.960588:0:6516:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789302307.960591:0:6516:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789302307 00002000:00010000:2.0:1789302307.960595:0:6516:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789302307 00002000:00010000:2.0:1789302307.960597:0:6516:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789302307 00002000:00010000:2.0:1789302307.960599:0:6516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789302307.960607:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 11 pid: 14588 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.960623:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 11 pid: 14588 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.960653:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c494502/0x1ff82925bd39a14e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d45 expref: 11 pid: 14588 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.960674:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1789302307.960680:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 1) 00010000:00010000:2.0:1789302307.960686:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.960696:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.960751:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302307.960815:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+10:2396:x1876219101544832:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 276us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302307.960822:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 95 00010000:00010000:0.0:1789302307.960969:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.960981:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.961005:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.961025:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.961034:0:8447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.961042:0:8447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311dc00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302307.961066:0:8447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.961077:0:8447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.961091:0:8447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302307.961099:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abe41dba/0x1ff82925bd39a18d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302307.961190:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+9:2398:x1876219101544576:12345-192.168.203.9@tcp:1:lfs.0 Request processed in 21382us (21598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302307.961200:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 69 00000100:00100000:3.0:1789302307.963705:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302307.963798:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101545088 00000100:00100000:2.0:1789302307.963811:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101545088 00000100:00100000:2.0:1789302307.963875:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 56 00000100:00100000:2.0:1789302307.963885:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93f4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+47:12431:x1876219101545088:12345-192.168.203.9@tcp:35:lfs.0 00000004:00010000:2.0:1789302307.963963:0:6533:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a17f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d5a expref: 47 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302307.964222:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789302307.964257:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1789302307.964863:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:2.0:1789302307.964932:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.964950:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a139 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d37 expref: 51 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.964959:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.965002:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a139 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d37 expref: 51 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.965019:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a139 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d37 expref: 51 pid: 6532 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302307.965064:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6533:1876219121525760:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302307.965860:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484e853c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302307.976885:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6533:1876219121525760:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302307.976931:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302307.977476:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302307.977664:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101545216 00000100:00100000:1.0:1789302307.977675:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101545216 00010000:00010000:1.0:1789302307.977723:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a139 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d37 expref: 52 pid: 6532 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302307.977775:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 96 00000100:00100000:1.0:1789302307.977785:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+52:2398:x1876219101545216:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302307.977805:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302307.977813:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a139 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d37 expref: 52 pid: 6532 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.977828:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a139 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d37 expref: 52 pid: 6532 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.977856:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a139 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d37 expref: 52 pid: 6532 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.977876:0:13201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:1.0:1789302307.977881:0:13201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.977892:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.977913:0:13201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.977950:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302307.978024:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+51:2398:x1876219101545216:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 239us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302307.978032:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 96 00010000:00010000:2.0:1789302307.978340:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302307.978350:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302307.978498:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:2.0:1789302307.978647:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789302307.978754:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6533:1876219121525888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789302307.978823:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302307.978861:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302307.978987:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121525888 00000100:00100000:1.0:1789302307.978995:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121525888 00000100:00100000:1.0:1789302307.979065:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789302307.979074:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6533:x1876219121525888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789302307.979201:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6533:x1876219121525888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 129us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302307.979209:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1789302307.979984:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302307.980034:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6533:1876219121525888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789302307.980248:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1789302307.980765:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bdbbd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6533:1876219121526016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789302307.980829:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302307.980864:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484e85d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302307.980932:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121526016 00000100:00100000:1.0:1789302307.980941:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121526016 00000100:00100000:1.0:1789302307.980995:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789302307.981004:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6533:x1876219121526016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789302307.981208:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6533:x1876219121526016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 205us (378us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789302307.981217:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789302307.981736:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bdbbd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6533:1876219121526016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789302307.981813:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1789302307.981865:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.981877:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.981886:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.981893:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302307.981898:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.981907:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.981927:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:3.0:1789302307.981931:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789302307.981937:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302307.981944:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a194 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789302307.982087:0:6533:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789302307.982207:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1789302307.982222:0:6533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384025108858ns, next at 385025106105ns, rc = 0 00000001:00080000:3.0:1789302307.982232:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:3.0:1789302307.982259:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc381fa9100) 00010000:00010000:3.0:1789302307.982279:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789302307.982287:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a17f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d5a expref: 55 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302307.983895:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93f4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+54:12431:x1876219101545088:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 20005us (20195us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789302307.983906:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 56 00000020:00080000:3.0:1789302307.983915:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789302307.993723:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302307.993869:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101545344 00000100:00100000:1.0:1789302307.993883:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101545344 00000100:00100000:1.0:1789302307.993959:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 218 00000100:00100000:1.0:1789302307.993973:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+54:12431:x1876219101545344:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302307.994006:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302307.994066:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39a19b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d61 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.994186:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39a19b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d61 expref: 55 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.994206:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39a19b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d61 expref: 55 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302307.994230:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:1.0:1789302307.994233:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302307.994238:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aa200, rc 0) 00000100:00100000:1.0:1789302307.994316:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+55:12431:x1876219101545344:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 346us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302307.994324:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 218 00000100:00100000:0.0:1789302307.998570:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302308.007561:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101545600 00000100:00100000:3.0:1789302308.007577:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101545600 00000100:00100000:2.0:1789302308.007780:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 57 00000100:00100000:2.0:1789302308.007796:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+55:12431:x1876219101545600:12345-192.168.203.9@tcp:35:lfs.0 00000100:00080000:3.0:1789302308.007846:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302308.008209:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+56:12431:x1876219101545600:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 415us (9652us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789302308.008219:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 57 00000100:00100000:3.0:1789302308.120312:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.120929:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101545728 00000100:00100000:2.0:1789302308.120946:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101545728 00000100:00100000:2.0:1789302308.121233:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 219 00000100:00100000:2.0:1789302308.121250:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+56:12441:x1876219101545728:12345-192.168.203.9@tcp:34:lfs.0 00010000:00010000:2.0:1789302308.121362:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1a2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122281:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122302:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122328:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122336:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122343:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122694:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122704:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122733:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302308.122801:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122817:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122825:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1a2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122833:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122839:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302308.122844:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122852:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1a2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122868:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302308.122871:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302308.122878:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122885:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122902:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122915:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122921:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122926:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302308.122930:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122936:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122944:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc4adc10900) 00010000:00010000:2.0:1789302308.122947:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302308.122949:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122956:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122966:0:10111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122971:0:10111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122977:0:10111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122982:0:10111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302308.122990:0:10111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.122996:0:10111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.123003:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:2.0:1789302308.123005:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302308.123008:0:10111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.123014:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302308.125007:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93c9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+56:12441:x1876219101545728:12345-192.168.203.9@tcp:34:lfs.0 Request processed in 3746us (4691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.125024:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 219 00000100:00100000:3.0:1789302308.196561:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.196709:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101545984 00000100:00100000:2.0:1789302308.196727:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101545984 00000100:00100000:2.0:1789302308.196830:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 220 00000100:00100000:2.0:1789302308.196844:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+56:12444:x1876219101545984:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302308.196872:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302308.196902:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d68 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.197008:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1be lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.197027:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.197070:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.197084:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.197094:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.197101:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.197657:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a1cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.197667:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a1cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.197675:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a1cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302308.197688:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789302308.198007:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198017:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198025:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198032:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302308.198057:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198066:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198081:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302308.198084:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302308.198090:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1be lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198096:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1be lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198202:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198211:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198216:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198222:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302308.198225:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198231:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198240:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc4adc10900) 00010000:00010000:2.0:1789302308.198242:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302308.198251:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198257:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198308:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d68 expref: 59 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198324:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a1cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d68 expref: 58 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.198331:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:2.0:1789302308.198333:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302308.198336:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348000, rc 0) 00000100:00100000:2.0:1789302308.198442:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+58:12444:x1876219101545984:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 1600us (1888us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1789302308.198452:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 220 00000100:00100000:0.0:1789302308.203835:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.203921:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101546112 00000100:00100000:2.0:1789302308.203934:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101546112 00000100:00100000:2.0:1789302308.204072:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 221 00000100:00100000:2.0:1789302308.204085:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+58:12444:x1876219101546112:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:2.0:1789302308.204208:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.204231:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.204247:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.204319:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.204327:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.204335:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.204342:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302308.204347:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.204355:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.204368:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:2.0:1789302308.204372:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302308.204379:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.204399:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302308.204498:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+58:12444:x1876219101546112:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 415us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.204507:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 221 00000100:00100000:3.0:1789302308.207340:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.207670:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101546368 00000100:00100000:2.0:1789302308.207683:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101546368 00000100:00100000:2.0:1789302308.207765:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 58 00000100:00100000:2.0:1789302308.207803:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+58:12444:x1876219101546368:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:2.0:1789302308.208150:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+59:12444:x1876219101546368:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 349us (833us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789302308.208160:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 58 00010000:00010000:3.0:1789302308.246535:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302308.315821:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.317879:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101546624 00000100:00100000:2.0:1789302308.317913:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101546624 00000100:00100000:2.0:1789302308.318012:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 222 00000100:00100000:2.0:1789302308.318026:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+59:12454:x1876219101546624:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1789302308.318071:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302308.318076:0:10111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789302308.318147:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a15c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d4c expref: 59 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.318176:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302308.318183:0:10111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302308.318201:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d6f expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.318342:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.318357:0:10111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a1cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d68 expref: 59 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.318368:0:10111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.318724:0:10111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a1cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d68 expref: 59 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.318758:0:10111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a1cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d68 expref: 59 pid: 6532 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302308.318887:0:10111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10111:1876219121526144:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302308.319030:0:10111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852cdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302308.327013:0:10111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10111:1876219121526144:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302308.327029:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00010000:00010000:2.0:1789302308.327066:0:10111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302308.327231:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101546752 00000100:00100000:1.0:1789302308.327242:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101546752 00010000:00010000:1.0:1789302308.327298:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a1cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d68 expref: 60 pid: 6532 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302308.327341:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 97 00000100:00100000:1.0:1789302308.327352:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+60:2399:x1876219101546752:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302308.327367:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302308.327374:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a1cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d68 expref: 60 pid: 6532 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.327398:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a1cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d68 expref: 60 pid: 6532 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.327441:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a1cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d68 expref: 60 pid: 6532 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.327461:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:1.0:1789302308.327466:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.327476:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.327485:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.327512:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302308.327572:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+59:2399:x1876219101546752:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 222us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302308.327580:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 97 00010000:00010000:3.0:1789302308.328144:0:10111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.328154:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302308.328174:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789302308.328312:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a1e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d6f expref: 60 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.328330:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d6f expref: 59 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.328352:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302308.328355:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789302308.328357:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349000, rc 0) 00000100:00100000:3.0:1789302308.328538:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+59:12454:x1876219101546624:12345-192.168.203.9@tcp:101:bash.0 Request processed in 10514us (12732us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789302308.328546:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 222 00000100:00100000:3.0:1789302308.338796:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.338904:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101546880 00000100:00100000:2.0:1789302308.338920:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101546880 00000100:00100000:2.0:1789302308.339005:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 223 00000100:00100000:2.0:1789302308.339017:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+59:12454:x1876219101546880:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1789302308.339064:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302308.339095:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a1f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d76 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.339183:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.339201:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.339214:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.339370:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a1f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d76 expref: 61 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.339585:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d76 expref: 60 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.339594:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:2.0:1789302308.339598:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789302308.339602:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348e00, rc 0) 00000100:00100000:2.0:1789302308.339673:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+60:12454:x1876219101546880:12345-192.168.203.9@tcp:101:bash.0 Request processed in 658us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.339680:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 223 00000100:00100000:0.0:1789302308.342248:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.342336:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101547136 00000100:00100000:2.0:1789302308.342352:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101547136 00000100:00100000:2.0:1789302308.342445:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 224 00000100:00100000:2.0:1789302308.342457:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+60:12454:x1876219101547136:12345-192.168.203.9@tcp:36:bash.0 00010000:00010000:2.0:1789302308.342737:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.342759:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.342781:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302308.342832:0:6530:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:2.0:1789302308.342858:0:6530:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f5672f9 reply state 00000000999c75cc transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.342873:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.342894:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:2.0:1789302308.342897:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789302308.342902:0:6530:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302308.343012:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+63:12454:x1876219101547136:12345-192.168.203.9@tcp:36:bash.0 Request processed in 557us (772us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1789302308.343020:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 224 00000020:00080000:2.0:1789302308.343026:0:6530:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789302308.350945:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302308.351097:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101547264 00000100:00100000:3.0:1789302308.351106:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101547264 00000100:00100000:3.0:1789302308.351199:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 225 00000100:00100000:3.0:1789302308.351208:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+63:12454:x1876219101547264:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302308.351232:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302308.351269:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a20b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d7d expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.351352:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.351365:0:10111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d6f expref: 64 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.351374:0:10111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.351403:0:10111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d6f expref: 64 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.351431:0:10111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d6f expref: 64 pid: 10111 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302308.351444:0:10111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10111:1876219121526272:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302308.351511:0:10111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383996180 going to sleep for 11 seconds 00000100:00100000:2.0:1789302308.353576:0:10111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10111:1876219121526272:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302308.353626:0:10111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302308.354458:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302308.354528:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101547392 00000100:00100000:3.0:1789302308.354537:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101547392 00010000:00010000:3.0:1789302308.354572:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d6f expref: 65 pid: 10111 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302308.354610:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 98 00000100:00100000:3.0:1789302308.354618:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+65:2399:x1876219101547392:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302308.354632:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302308.354639:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d6f expref: 65 pid: 10111 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.354653:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d6f expref: 65 pid: 10111 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.354677:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a1e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d6f expref: 65 pid: 10111 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.354694:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302308.354698:0:10408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.354724:0:10408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.354738:0:10408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302308.354765:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302308.354813:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+64:2399:x1876219101547392:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 194us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302308.354820:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 98 00010000:00010000:2.0:1789302308.355458:0:10111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.355475:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302308.355620:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789302308.355626:0:10111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302308.355654:0:10111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.355702:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983c00/0x1ff82925bd39a20b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d7d expref: 64 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.355724:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d7d expref: 63 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.355734:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:2.0:1789302308.355753:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302308.355757:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982800, rc 0) 00000100:00100000:2.0:1789302308.355953:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+63:12454:x1876219101547264:12345-192.168.203.9@tcp:101:bash.0 Request processed in 4744us (5014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.355963:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 225 00000100:00100000:0.0:1789302308.360017:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.360102:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101547648 00000100:00100000:2.0:1789302308.360160:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101547648 00000100:00100000:2.0:1789302308.360239:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 59 00000100:00100000:2.0:1789302308.360252:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+63:12454:x1876219101547648:12345-192.168.203.9@tcp:35:bash.0 00000100:00100000:2.0:1789302308.360574:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+64:12454:x1876219101547648:12345-192.168.203.9@tcp:35:bash.0 Request processed in 319us (560us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789302308.360582:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 59 00000100:00100000:3.0:1789302308.457723:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302308.458404:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101547776 00000100:00100000:1.0:1789302308.458414:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101547776 00000100:00100000:1.0:1789302308.458474:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 226 00000100:00100000:1.0:1789302308.458483:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+64:12460:x1876219101547776:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302308.458505:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302308.458527:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39a219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d84 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.458588:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd39a220 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.458618:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd39a220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.458631:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd39a220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302308.458674:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789302308.458677:0:9541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302308.458695:0:9541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd39a220 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.458718:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39a219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d84 expref: 66 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.458734:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd39a220 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d84 expref: 65 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.458741:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302308.458744:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302308.458747:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839ab200, rc 0) 00000100:00100000:1.0:1789302308.458803:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+65:12460:x1876219101547776:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 323us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302308.458811:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 226 00000100:00100000:0.0:1789302308.465684:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302308.465842:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101547904 00000100:00100000:1.0:1789302308.465855:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101547904 00000100:00100000:1.0:1789302308.465958:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 227 00000100:00100000:1.0:1789302308.465968:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+65:12460:x1876219101547904:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302308.465985:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302308.466016:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a227 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d8b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.466803:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a22e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.466817:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a22e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.466829:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a22e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.466840:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a235 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.466848:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.466854:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.466915:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a23c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.466924:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a23c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.466930:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a23c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302308.466971:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789302308.466975:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302308.466991:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a23c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.467011:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a23c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.467019:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a22e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.467038:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a22e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.467054:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a22e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.467061:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302308.467065:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a22e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.467073:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a22e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.467085:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302308.467088:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302308.467093:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a22e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.467100:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a22e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.468607:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a235 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.468629:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a235 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.468650:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a235 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.468655:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839abc00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302308.468660:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a235 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.468667:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a235 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.468681:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc4adc10900) 00010000:00010000:1.0:1789302308.468683:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302308.468688:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a235 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.468694:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a235 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.468733:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a227 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d8b expref: 67 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.468747:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a23c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d8b expref: 66 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.468755:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:1.0:1789302308.468757:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302308.468759:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aaa00, rc 0) 00000100:00100000:1.0:1789302308.468880:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+66:12460:x1876219101547904:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 2912us (3209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302308.468896:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 227 00000100:00100000:0.0:1789302308.474675:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.474777:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101548032 00000100:00100000:2.0:1789302308.474795:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101548032 00000100:00100000:2.0:1789302308.474882:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:2.0:1789302308.474895:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+66:2398:x1876219101548032:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302308.474914:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302308.475848:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39a23c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d8b expref: 66 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.475876:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:2.0:1789302308.475882:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302308.476064:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+65:2398:x1876219101548032:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 1172us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.476199:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:3.0:1789302308.476625:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302308.477101:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101548288 00000100:00100000:1.0:1789302308.477188:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101548288 00000100:00100000:1.0:1789302308.477796:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 228 00000100:00100000:1.0:1789302308.477809:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+65:12460:x1876219101548288:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302308.477829:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302308.477849:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39a243 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d92 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.477948:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.477963:0:10111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d7d expref: 66 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.477972:0:10111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.478005:0:10111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d7d expref: 66 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.478018:0:10111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d7d expref: 66 pid: 10111 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302308.478031:0:10111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10111:1876219121526400:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302308.478167:0:10111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49a5d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302308.484689:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.484814:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101548416 00000100:00100000:2.0:1789302308.484843:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101548416 00010000:00010000:2.0:1789302308.484894:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d7d expref: 67 pid: 10111 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302308.484964:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 99 00000100:00100000:2.0:1789302308.484975:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+67:2396:x1876219101548416:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302308.484992:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302308.484999:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d7d expref: 67 pid: 10111 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.485014:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d7d expref: 67 pid: 10111 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.485051:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:2.0:1789302308.485058:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.485081:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.485091:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.485143:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302308.485208:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+67:2396:x1876219101548416:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 234us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.485217:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 99 00010000:00010000:1.0:1789302308.488982:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a212 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d7d expref: 66 pid: 10111 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302308.489048:0:10111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10111:1876219121526400:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302308.489091:0:10111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302308.489190:0:10111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302308.489216:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302308.489238:0:10111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789302308.489406:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39a243 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d92 expref: 67 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302308.489427:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d92 expref: 66 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302308.489436:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:0.0:1789302308.489439:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789302308.489443:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839ab800, rc 0) 00000100:00100000:0.0:1789302308.489510:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+66:12460:x1876219101548288:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 11703us (12886us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789302308.489518:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 228 00000100:00100000:3.0:1789302308.494710:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.494885:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101548672 00000100:00100000:2.0:1789302308.494898:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101548672 00000100:00100000:2.0:1789302308.495570:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:2.0:1789302308.495586:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+66:12460:x1876219101548672:12345-192.168.203.9@tcp:103:lfs.0 00010000:00010000:2.0:1789302308.495607:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302308.495640:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39a19b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d61 expref: 66 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.495665:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:2.0:1789302308.495672:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302308.502710:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+65:12460:x1876219101548672:12345-192.168.203.9@tcp:103:lfs.0 Request processed in 7110us (7994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.502731:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:0.0:1789302308.506808:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302308.508475:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101548800 00000100:00100000:1.0:1789302308.508490:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101548800 00000100:00100000:0.0:1789302308.508689:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 229 00000100:00100000:0.0:1789302308.508703:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+65:12460:x1876219101548800:12345-192.168.203.9@tcp:58:lfs.0 00010000:00010000:0.0:1789302308.508895:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302308.509057:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302308.509082:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789302308.509225:0:9541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789302308.509342:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+65:12460:x1876219101548800:12345-192.168.203.9@tcp:58:lfs.0 Request processed in 641us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302308.509352:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 229 00000100:00100000:0.0:1789302308.516948:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302308.517616:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101548928 00000100:00100000:1.0:1789302308.517631:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101548928 00000100:00100000:1.0:1789302308.517827:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 230 00000100:00100000:1.0:1789302308.517841:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+65:12460:x1876219101548928:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302308.517869:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302308.517896:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a25f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5d99 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.517969:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.517982:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a25f lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d99 expref: 66 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.518005:0:6531:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.518019:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a25f lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d99 expref: 66 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.518034:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:1.0:1789302308.518066:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302308.518081:0:6531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a25f lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d99 expref: 66 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.518090:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aa000, rc 0) 00000100:00100000:1.0:1789302308.518184:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+66:12460:x1876219101548928:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 346us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302308.518191:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 230 00000040:00080000:3.0:1789302308.884428:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302308.884444:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302308.884477:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789302308.884487:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789302308.885435:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121526528:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789302308.886286:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383996f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302308.896387:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302308.896525:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121526528:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789302308.896854:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101549056 00000100:00100000:2.0:1789302308.896865:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101549056 00000100:00100000:2.0:1789302308.896939:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 231 00000100:00100000:2.0:1789302308.897167:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+66:12461:x1876219101549056:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789302308.897213:0:10111:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789302308.897362:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+66:12461:x1876219101549056:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 413us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.897370:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 231 00000100:00100000:0.0:1789302308.908899:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.910241:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101549184 00000100:00100000:2.0:1789302308.910256:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101549184 00000100:00100000:2.0:1789302308.910347:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 232 00000100:00100000:2.0:1789302308.910359:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+66:12461:x1876219101549184:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789302308.910458:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a266 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.910480:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a266 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.910512:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a266 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.910532:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a26d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.910539:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a26d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.910546:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a26d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911026:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a274 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911047:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a274 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911055:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a274 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302308.911211:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789302308.911217:0:9541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302308.911232:0:9541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a274 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911245:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a266 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911252:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a266 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911274:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a266 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911281:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302308.911286:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a266 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911295:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a266 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911309:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:2.0:1789302308.911313:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302308.911319:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a266 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911326:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a266 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911345:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a26d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911352:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a26d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911358:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a26d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911364:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302308.911368:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a26d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911385:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a26d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911394:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8cc4adc10b00) 00010000:00010000:2.0:1789302308.911396:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302308.911400:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a26d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911406:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a26d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911423:0:9541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a274 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911430:0:9541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a274 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911436:0:9541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a274 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911442:0:9541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302308.911445:0:9541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a274 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911451:0:9541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a274 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911458:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:2.0:1789302308.911461:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302308.911464:0:9541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a274 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.911480:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a274 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302308.912257:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+66:12461:x1876219101549184:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 1893us (3366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.912271:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 232 00000100:00100000:0.0:1789302308.918521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302308.925799:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101549440 00000100:00100000:1.0:1789302308.925836:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101549440 00000100:00100000:1.0:1789302308.925938:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 233 00000100:00100000:1.0:1789302308.926294:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+66:12461:x1876219101549440:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302308.926323:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302308.926354:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a27b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5da0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.926500:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a282 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.926520:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.926535:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302308.926550:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789302308.928925:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.928945:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a282 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.929189:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a282 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.929196:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302308.929201:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a282 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.929211:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a282 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.929232:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:1.0:1789302308.929235:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789302308.929240:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a282 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.929247:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a282 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.929323:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a27b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5da0 expref: 68 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.929335:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:1.0:1789302308.929338:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302308.929342:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839abc00/0x1ff82925bd39a27b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5da0 expref: 68 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.929353:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839abc00, rc 0) 00000100:00100000:1.0:1789302308.929454:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+67:12461:x1876219101549440:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 3505us (10945us total) trans 4294967506 rc 301/301 00000100:00100000:1.0:1789302308.929474:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 233 00000100:00100000:0.0:1789302308.937973:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.938155:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101549568 00000100:00100000:2.0:1789302308.938169:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101549568 00000100:00100000:2.0:1789302308.938246:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 234 00000100:00100000:2.0:1789302308.938259:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+67:12461:x1876219101549568:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789302308.938305:0:10111:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789302308.938435:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+67:12461:x1876219101549568:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 180us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.938445:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 234 00000100:00100000:1.0:1789302308.943193:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.943349:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101549824 00000100:00100000:2.0:1789302308.943362:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101549824 00000100:00100000:2.0:1789302308.943437:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 235 00000100:00100000:2.0:1789302308.943449:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+67:12461:x1876219101549824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302308.943474:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302308.943478:0:9541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789302308.943511:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab200/0x1ff82925bd39a220 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d84 expref: 67 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.943533:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:2.0:1789302308.943540:0:9541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302308.943558:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a290 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5da7 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302308.944680:0:9541:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789302308.944881:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a297 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.944900:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a297 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.944913:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a297 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.946093:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39a290 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5da7 expref: 69 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.946154:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a297 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5da7 expref: 68 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.946165:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10b00) 00010000:00010000:2.0:1789302308.946167:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302308.946172:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349000, rc 0) 00000100:00100000:2.0:1789302308.946269:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+68:12461:x1876219101549824:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2821us (3090us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789302308.946280:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 235 00000100:00100000:3.0:1789302308.958471:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302308.958624:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101550080 00000100:00100000:1.0:1789302308.958638:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101550080 00000100:00100000:1.0:1789302308.958705:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 236 00000100:00100000:1.0:1789302308.958717:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+68:12461:x1876219101550080:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302308.958800:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302308.958837:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349000/0x1ff82925bd39a297 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5da7 expref: 68 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.958864:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10b00) 00010000:00010000:1.0:1789302308.958877:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302308.958903:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a2a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.958920:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a2a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.958932:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a2a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.958949:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39a2ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xcf0887c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.958969:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39a2ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf0887c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.958976:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39a2ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf0887c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959067:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a2a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959075:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a2a5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959083:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a2a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959089:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302308.959094:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a2a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959103:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a2a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959139:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:1.0:1789302308.959142:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302308.959147:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a2a5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959153:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a2a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959164:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39a2ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf0887c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959171:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39a2ac lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf0887c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959178:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39a2ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf0887c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959189:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302308.959192:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39a2ac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf0887c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959198:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39a2ac lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf0887c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959206:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xcf0887c9 (ffff8cc383960200) 00010000:00010000:1.0:1789302308.959209:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302308.959212:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39a2ac lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xcf0887c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.959218:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39a2ac lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xcf0887c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302308.959312:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+67:12461:x1876219101550080:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 598us (855us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302308.959321:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 236 00000100:00100000:1.0:1789302308.964137:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.964231:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101550208 00000100:00100000:2.0:1789302308.964246:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101550208 00000100:00100000:2.0:1789302308.964327:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 237 00000100:00100000:2.0:1789302308.964338:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+67:12461:x1876219101550208:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302308.964365:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302308.964428:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a2b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5dae expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.964476:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a2ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.964492:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a2ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.964507:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a2ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.964657:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a2b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dae expref: 69 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.964682:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a2ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dae expref: 68 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.964691:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:2.0:1789302308.964694:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789302308.964698:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348000, rc 0) 00000100:00100000:2.0:1789302308.964948:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+68:12461:x1876219101550208:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 610us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.964958:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 237 00000100:00100000:3.0:1789302308.968160:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302308.968791:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101550464 00000100:00100000:1.0:1789302308.968806:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101550464 00000100:00100000:1.0:1789302308.968881:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 238 00000100:00100000:1.0:1789302308.968895:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+68:12461:x1876219101550464:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302308.969024:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.969055:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.969091:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789302308.969320:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1789302308.969332:0:6532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385012219051ns, next at 386012215732ns, rc = 0 00000004:00010000:1.0:1789302308.969390:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004dd7515 reply state 00000000f1d1fc6d transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.969405:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302308.969413:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:1.0:1789302308.969416:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789302308.969421:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302308.969546:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+70:12461:x1876219101550464:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 653us (1430us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789302308.969555:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 238 00000100:00100000:3.0:1789302308.974344:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.974560:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101550592 00000100:00100000:2.0:1789302308.974585:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101550592 00000100:00100000:2.0:1789302308.974669:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 239 00000100:00100000:2.0:1789302308.974682:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+70:12461:x1876219101550592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302308.974713:0:10111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302308.974768:0:10111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a2c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5db5 expref: -99 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.974848:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5db5 expref: 71 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.974867:0:10111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5db5 expref: 71 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302308.974891:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:2.0:1789302308.974894:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302308.974899:0:10111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f400, rc 0) 00000100:00100000:2.0:1789302308.974971:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+71:12461:x1876219101550592:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 293us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302308.974979:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 239 00000001:00080000:1.0:1789302308.985999:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1789302308.986015:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1789302308.987424:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.987503:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101550720 00000100:00100000:2.0:1789302308.987521:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101550720 00000100:00100000:2.0:1789302308.987625:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 70 00000100:00080000:3.0:1789302308.987637:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302308.987647:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+9:2398:x1876219101550720:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789302308.987959:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+10:2398:x1876219101550720:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 315us (535us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789302308.987969:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 70 00000100:00100000:0.0:1789302308.991306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302308.991736:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101550976 00000100:00100000:2.0:1789302308.991754:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101550976 00000100:00100000:2.0:1789302308.991846:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:2.0:1789302308.991862:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+71:12461:x1876219101550976:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789302308.992219:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+72:12461:x1876219101550976:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 359us (920us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789302308.992247:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:0.0:1789302309.001821:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302309.002263:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101551232 00000100:00100000:1.0:1789302309.002274:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101551232 00000100:00100000:0.0:1789302309.002441:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 240 00000100:00100000:0.0:1789302309.002451:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+72:12461:x1876219101551232:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789302309.002568:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+72:12461:x1876219101551232:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 118us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302309.002575:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 240 00000100:00100000:1.0:1789302309.006390:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302309.006466:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101551360 00000100:00100000:0.0:1789302309.006475:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101551360 00000100:00100000:0.0:1789302309.006541:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 241 00000100:00100000:0.0:1789302309.006552:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+72:12461:x1876219101551360:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302309.006588:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302309.006609:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39a2cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5dbc expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.006680:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39a2d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.006695:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39a2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.006706:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39a2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302309.006760:0:9541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789302309.006779:0:9541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39a2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.006804:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311cc00/0x1ff82925bd39a2cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dbc expref: 74 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.006822:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39a2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dbc expref: 73 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.006831:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:0.0:1789302309.006834:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789302309.006837:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311d800, rc 0) 00000100:00100000:0.0:1789302309.006894:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+73:12461:x1876219101551360:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 344us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302309.006902:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 241 00000100:00100000:1.0:1789302309.009582:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302309.009697:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101551488 00000100:00100000:2.0:1789302309.009705:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101551488 00000100:00100000:2.0:1789302309.009767:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 71 00000100:00100000:2.0:1789302309.009778:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+10:2398:x1876219101551488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302309.009794:0:14588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302309.009814:0:14588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021d83b2e/0x1ff82925bd39a2dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5dc3 expref: -99 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302309.009839:0:14588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa69624, blocks: 0x0 00010000:00010000:2.0:1789302309.009859:0:14588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1789302309.009864:0:14588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302309.009871:0:14588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021d83b2e/0x1ff82925bd39a2dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dc3 expref: 11 pid: 14588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.009886:0:14588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021d83b2e/0x1ff82925bd39a2dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dc3 expref: 11 pid: 14588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.009896:0:14588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349c00, rc 0) 00000100:00100000:2.0:1789302309.009956:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+11:2398:x1876219101551488:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 179us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302309.009964:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 71 00000100:00100000:1.0:1789302309.012749:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302309.012942:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101551744 00000100:00100000:3.0:1789302309.012953:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101551744 00000100:00100000:3.0:1789302309.013067:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 242 00000100:00100000:3.0:1789302309.013077:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+73:12461:x1876219101551744:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789302309.013221:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+73:12461:x1876219101551744:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 144us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302309.013228:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 242 00000100:00100000:1.0:1789302309.016463:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302309.016612:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101551872 00000100:00100000:0.0:1789302309.016623:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101551872 00000100:00100000:0.0:1789302309.016713:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:0.0:1789302309.016733:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+11:12461:x1876219101551872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302309.016751:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302309.016766:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5dca expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.016795:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021d83b2e/0x1ff82925bd39a2dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dc3 expref: 12 pid: 14588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.016804:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302309.016808:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302309.016814:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.016848:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021d83b2e/0x1ff82925bd39a2dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dc3 expref: 12 pid: 14588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.016862:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021d83b2e/0x1ff82925bd39a2dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dc3 expref: 12 pid: 14588 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.016876:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121526656:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302309.016975:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8300 going to sleep for 11 seconds 00000100:00100000:0.0:1789302309.019435:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1876219121526656:192.168.203.9@tcp:104: 00010000:00010000:0.0:1789302309.019465:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.019498:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311cc00, rc 0) 00000100:00100000:0.0:1789302309.019690:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+12:12461:x1876219101551872:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 2967us (3234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302309.019699:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:2.0:1789302309.021852:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302309.022806:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101552000 00000100:00100000:3.0:1789302309.022816:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101552000 00010000:00010000:3.0:1789302309.022854:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021d83b2e/0x1ff82925bd39a2dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dc3 expref: 12 pid: 14588 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.022887:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 100 00000100:00100000:3.0:1789302309.022896:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+12:2398:x1876219101552000:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302309.022909:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302309.022930:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021d83b2e/0x1ff82925bd39a2dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dc3 expref: 12 pid: 14588 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.022944:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021d83b2e/0x1ff82925bd39a2dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dc3 expref: 12 pid: 14588 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.022977:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021d83b2e/0x1ff82925bd39a2dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dc3 expref: 12 pid: 14588 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.022991:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302309.022995:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302309.023002:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.023028:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.023072:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.023086:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6517:1876219121526784:192.168.203.9@tcp:105: 00000100:00100000:3.0:1789302309.023192:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383996f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302309.028301:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302309.028936:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101552128 00000100:00100000:1.0:1789302309.028946:0:8451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101552128 00002000:00100000:1.0:1789302309.029009:0:8451:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8cc383a2b480 x1876219101552128/t0(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:640/0 lens 504/0 e 0 to 0 dl 1789302320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789302309.029033:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc383a2b480 with x1876219101552128 ext(0->12) 00002000:00010000:1.0:1789302309.029050:0:8451:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc383a2b480 00000100:00100000:1.0:1789302309.029086:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6 00000100:00100000:1.0:1789302309.029096:0:8451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c76ee310-c3b4-4286-aaea-77936c269d98+12:2398:x1876219101552128:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789302309.030242:0:8451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c76ee310-c3b4-4286-aaea-77936c269d98+14:2398:x1876219101552128:12345-192.168.203.9@tcp:4:lhsmtool_posix.0 Request processed in 1141us (1945us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789302309.030254:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6 00002000:00100000:1.0:1789302309.030264:0:8451:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8cc383a2b480 x1876219101552128/t4294967321(0) o4->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:640/0 lens 504/448 e 0 to 0 dl 1789302320 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789302309.030273:0:8451:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc383a2b480 with x1876219101552128 ext(0->12) 00002000:00010000:1.0:1789302309.030279:0:8451:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc383a2b480 00000100:00100000:3.0:1789302309.032629:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6517:1876219121526784:192.168.203.9@tcp:105: 00010000:00010000:3.0:1789302309.032667:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302309.032873:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+13:2398:x1876219101552000:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 9976us (11026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302309.032897:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 100 00000100:00100000:2.0:1789302309.033106:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302309.033692:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101552256 00000100:00100000:1.0:1789302309.033701:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101552256 00000100:00100000:1.0:1789302309.033762:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 243 00000100:00100000:1.0:1789302309.033773:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+73:12461:x1876219101552256:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789302309.036014:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:0.0:1789302309.036030:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1789302309.036081:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789302309.036102:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cc4bd95f240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789302309.036107:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc4aded5000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cc48831e180 00000020:00080000:0.0:1789302309.036126:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc4aded5200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cc483b9e800 00000004:00080000:0.0:1789302309.036149:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789302309.036175:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cc383996a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789302309.036178:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc38277a400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cc383996780 00000020:00080000:0.0:1789302309.036181:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc38277a200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cc38425b600 00000020:00080000:0.0:1789302309.036203:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789302309.036269:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789302309.036379:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+27:12461:x1876219101552256:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 2606us (3271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302309.036389:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 243 00000100:00100000:2.0:1789302309.036575:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121527040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789302309.036629:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302309.036678:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121527040 00000100:00100000:2.0:1789302309.036684:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121527040 00000100:00100000:2.0:1789302309.036736:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789302309.036744:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121527040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789302309.036840:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789302309.036844:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789302309 00002000:00010000:2.0:1789302309.036847:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789302309.036849:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789302308 -> 1789302309 00002000:00010000:2.0:1789302309.036852:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789302309.036881:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121527040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 138us (254us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789302309.036887:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:2.0:1789302309.036921:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc383a29c00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789302309.036926:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121527040:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789302309.037367:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037378:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037385:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037391:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302309.037409:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037417:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037433:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cc4c206f300) 00010000:00010000:1.0:1789302309.037436:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302309.037441:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037448:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd399fe9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037473:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037479:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037484:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037489:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302309.037492:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037497:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037505:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cc383960a00) 00010000:00010000:1.0:1789302309.037507:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302309.037516:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037533:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a091 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037550:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037557:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037563:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037568:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302309.037572:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037577:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037585:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc4adc10900) 00010000:00010000:1.0:1789302309.037588:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302309.037591:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037596:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a10f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037609:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037625:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037631:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037636:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983a00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302309.037639:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037645:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037652:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc4adc10900) 00010000:00010000:1.0:1789302309.037655:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302309.037657:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037662:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a132 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037677:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037683:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037690:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037695:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302309.037704:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037711:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037728:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:1.0:1789302309.037731:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302309.037734:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037740:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a204 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037751:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037758:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037763:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037768:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302309.037771:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037776:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037783:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:1.0:1789302309.037785:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789302309.037795:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.037800:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39a2c1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.037962:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121526912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789302309.038003:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789302309.038237:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302309.038287:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302309.038298:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121527168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789302309.038335:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302309.038473:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121526912 00000100:00100000:3.0:1789302309.038480:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121526912 00000100:00100000:3.0:1789302309.038517:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121527168 00000100:00100000:3.0:1789302309.038521:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121527168 00000100:00100000:3.0:1789302309.038557:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789302309.038565:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1876219121526912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789302309.038584:0:8852:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1789302309.038604:0:8852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.038622:0:8852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ada22175/0x1ff82925bd39a09f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d22 expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.038631:0:8852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789302309.038643:0:8852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302309.038648:0:8852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.038676:0:8852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ada22175/0x1ff82925bd39a09f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d22 expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.038690:0:8852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ada22175/0x1ff82925bd39a09f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d22 expref: 12 pid: 8447 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.038702:0:8852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8852:1876219121527296:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302309.038768:0:8852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383996f00 going to sleep for 11 seconds 00000100:00080000:3.0:1789302309.038778:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302309.038928:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789302309.038938:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121527168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789302309.039093:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1789302309.039141:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa69623, atime: 0x6aa69623, ctime: 0x6aa69623, blocks: 0x8 00010000:00010000:0.0:1789302309.039147:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000547ab13d/0x1ff82925bd39a2f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.039156:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1789302309.039159:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302309.039164:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000547ab13d/0x1ff82925bd39a2f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.039177:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000547ab13d/0x1ff82925bd39a2f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.039186:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000547ab13d/0x1ff82925bd39a2f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.039194:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000547ab13d/0x1ff82925bd39a2f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.039211:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789302309.039345:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121527168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 409us (1008us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789302309.039351:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789302309.039398:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789302309.039403:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:0.0:1789302309.039432:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cc381f7ea00, transno 4294967308 00000004:00080000:0.0:1789302309.039442:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:0.0:1789302309.039455:0:3647:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cc38489c700 x1876219121527168/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789302325 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789302309.039465:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc38489c700/2, rc 0, transno 4294967311 00000100:00100000:0.0:1789302309.039469:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121527168:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789302309.039911:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302309.039918:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000547ab13d/0x1ff82925bd39a2f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.039926:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311c000 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302309.039930:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000547ab13d/0x1ff82925bd39a2f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.039939:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000547ab13d/0x1ff82925bd39a2f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.039960:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000547ab13d/0x1ff82925bd39a2f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.039967:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000547ab13d/0x1ff82925bd39a2f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.039982:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302309.039984:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302309.039985:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302309.043535:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302309.043570:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302309.043599:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101552512 00000100:00100000:0.0:1789302309.043607:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101552512 00010000:00010000:0.0:1789302309.043647:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ada22175/0x1ff82925bd39a09f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d22 expref: 13 pid: 8447 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.043684:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 101 00000100:00100000:0.0:1789302309.043693:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+13:2399:x1876219101552512:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302309.043707:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302309.043713:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ada22175/0x1ff82925bd39a09f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d22 expref: 13 pid: 8447 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.043735:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ada22175/0x1ff82925bd39a09f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d22 expref: 13 pid: 8447 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.043759:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302309.043763:0:13201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302309.043781:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.043792:0:13201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.043811:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302309.043856:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+13:2399:x1876219101552512:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 164us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302309.043862:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 101 00010000:00010000:3.0:1789302309.044238:0:8852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ada22175/0x1ff82925bd39a09f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d22 expref: 12 pid: 8447 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.044255:0:8852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8852:1876219121527296:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302309.044276:0:8852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.044286:0:8852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.044294:0:8852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.044315:0:8852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.044324:0:8852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302309.044768:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101552384 00000100:00100000:2.0:1789302309.044774:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101552384 00000100:00100000:2.0:1789302309.044816:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 76 00000100:00100000:2.0:1789302309.044825:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+12:2396:x1876219101552384:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789302309.047320:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1789302309.047333:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1789302309.047510:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+7:2396:x1876219101552384:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 2679us (3985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302309.047521:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 76 00010000:00010000:3.0:1789302309.051512:0:8852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789302309.051762:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302309.051874:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101552768 00000100:00100000:3.0:1789302309.051884:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101552768 00000100:00100000:3.0:1789302309.051946:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 244 00000100:00100000:3.0:1789302309.051967:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+21:12461:x1876219101552768:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789302309.052018:0:10111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302309.052053:0:10111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d800/0x1ff82925bd39a2d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dbc expref: 21 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.052072:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:3.0:1789302309.052077:0:10111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302309.052109:0:10111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.052153:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.052164:0:10111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302309.052278:0:10111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007437b426 reply state 0000000059105ac1 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.052305:0:10111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.052311:0:10111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:3.0:1789302309.052314:0:10111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302309.052317:0:10111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302309.052411:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+22:12461:x1876219101552768:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 447us (654us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1789302309.052419:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 244 00010000:00010000:1.0:1789302309.052703:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302309.052712:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.052746:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302309.052751:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.052761:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.052776:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.052784:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d78d7566/0x1ff82925bd39a2eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.052802:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302309.052804:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302309.052806:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302309.053311:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876219121526912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14744us (15305us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789302309.053328:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302309.053437:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1789302309.053443:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1789302309.053462:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cc383a29c00, transno 4294967322 00000100:00100000:0.0:1789302309.053482:0:3646:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cc383a2b800 x1876219121526912/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789302325 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789302309.053493:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc383a2b800/2, rc 0, transno 4294967323 00000100:00100000:0.0:1789302309.053499:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121526912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789302309.056944:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302309.057028:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101552896 00000100:00100000:0.0:1789302309.057046:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101552896 00000100:00100000:0.0:1789302309.057101:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 77 00000100:00100000:0.0:1789302309.057143:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101552896:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789302309.057283:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789302309.057299:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789302309 -> 1789302308 00002000:00010000:0.0:1789302309.057302:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789302307 00002000:00010000:0.0:1789302309.057304:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789302309 -> 1789302308 00002000:00010000:0.0:1789302309.057306:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789302309.057361:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+8:2398:x1876219101552896:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 251us (425us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789302309.057369:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 77 00000100:00100000:2.0:1789302309.060373:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302309.060457:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101553152 00000100:00100000:3.0:1789302309.060467:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101553152 00000100:00100000:3.0:1789302309.060523:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 245 00000100:00100000:3.0:1789302309.060541:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+22:12461:x1876219101553152:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789302309.060607:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.060623:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a2ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dae expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.060633:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.060666:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a2ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dae expref: 22 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.060680:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a2ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dae expref: 22 pid: 6530 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.060709:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6530:1876219121527424:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302309.060909:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383996d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302309.064343:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302309.064472:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6530:1876219121527424:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302309.064512:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.064819:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101553280 00000100:00100000:0.0:1789302309.064828:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101553280 00010000:00010000:0.0:1789302309.064863:0:10408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a2ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dae expref: 23 pid: 6530 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.064900:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 102 00000100:00100000:0.0:1789302309.064910:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+23:2399:x1876219101553280:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302309.064924:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302309.064931:0:10408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a2ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dae expref: 23 pid: 6530 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.064943:0:10408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a2ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dae expref: 23 pid: 6530 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.064973:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348000/0x1ff82925bd39a2ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dae expref: 23 pid: 6530 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.064989:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:0.0:1789302309.064994:0:10408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.065020:0:10408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.065027:0:10408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.065064:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302309.065144:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+22:2399:x1876219101553280:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 234us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302309.065152:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 102 00010000:00010000:3.0:1789302309.065789:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.065799:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.065834:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.065840:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.065847:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.065853:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302309.065856:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.065863:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.065874:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:3.0:1789302309.065876:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789302309.065880:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.065898:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a300 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.065958:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+21:12461:x1876219101553152:12345-192.168.203.9@tcp:55:lhsmtool_posix.0 Request processed in 5419us (5593us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789302309.065966:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 245 00000100:00100000:3.0:1789302309.069448:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302309.069518:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101553408 00000100:00100000:0.0:1789302309.069535:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101553408 00000100:00100000:0.0:1789302309.069593:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 78 00000100:00100000:0.0:1789302309.069603:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+8:2399:x1876219101553408:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789302309.069646:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.069666:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.069675:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302309.069679:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302309.069683:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.069713:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.069755:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 8 pid: 8447 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.069770:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1876219121527552:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302309.069851:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302309.074276:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302309.074352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101553536 00000100:00100000:3.0:1789302309.074361:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101553536 00010000:00010000:3.0:1789302309.074410:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 9 pid: 8447 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.074454:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 103 00000100:00100000:3.0:1789302309.074463:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+9:2399:x1876219101553536:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302309.074478:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302309.074497:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 9 pid: 8447 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.074511:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 9 pid: 8447 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.074543:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302309.074548:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302309.074554:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.074583:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.074604:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302309.074659:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c76ee310-c3b4-4286-aaea-77936c269d98+9:2399:x1876219101553536:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 196us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302309.074666:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 103 00010000:00010000:0.0:1789302309.074869:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5feaf38/0x1ff82925bd39a2e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dca expref: 8 pid: 8447 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.074884:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1876219121527552:192.168.203.9@tcp:104: 00010000:00010000:0.0:1789302309.074905:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.074916:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.074923:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.074942:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.074951:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.074970:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.074977:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311d400 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302309.074981:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.074991:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.075003:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.075011:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000574ca331/0x1ff82925bd39a307 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.075069:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+7:2399:x1876219101553408:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 5468us (5630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302309.075076:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 78 00000100:00100000:1.0:1789302309.078787:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302309.078904:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101553792 00000100:00100000:0.0:1789302309.078915:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101553792 00000100:00100000:0.0:1789302309.078975:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 246 00000100:00100000:0.0:1789302309.078985:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+21:12461:x1876219101553792:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789302309.079066:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.079097:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d76 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.079108:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.079185:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d76 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.079199:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d76 expref: 21 pid: 6532 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.079213:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6532:1876219121527680:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302309.079282:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302309.082348:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302309.082416:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101553920 00000100:00100000:3.0:1789302309.082425:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101553920 00010000:00010000:3.0:1789302309.082460:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1fd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d76 expref: 22 pid: 6532 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.082497:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 104 00000100:00100000:3.0:1789302309.082505:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+22:2399:x1876219101553920:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302309.082519:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302309.082533:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1fd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d76 expref: 22 pid: 6532 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.082547:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d76 expref: 22 pid: 6532 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.082568:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302309.082575:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a25f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d99 expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.082586:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.082606:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.082613:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.082630:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302309.082676:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c76ee310-c3b4-4286-aaea-77936c269d98+22:2399:x1876219101553920:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 171us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302309.082683:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 104 00010000:00010000:0.0:1789302309.083488:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a1fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d76 expref: 21 pid: 6532 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.083507:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6532:1876219121527680:192.168.203.9@tcp:104: 00010000:00010000:0.0:1789302309.083533:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.083542:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.083548:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.083715:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.083746:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a2c8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5db5 expref: 21 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.083754:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.083780:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5db5 expref: 21 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.083793:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a2c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5db5 expref: 21 pid: 10111 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.083806:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6532:1876219121527808:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302309.083871:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302309.088500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302309.088637:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6532:1876219121527808:192.168.203.9@tcp:104: 00010000:00010000:0.0:1789302309.088664:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302309.088737:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101554048 00000100:00100000:1.0:1789302309.088745:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101554048 00010000:00010000:1.0:1789302309.088778:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a2c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5db5 expref: 22 pid: 10111 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302309.088814:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 105 00000100:00100000:1.0:1789302309.088823:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+22:2398:x1876219101554048:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302309.088837:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302309.088857:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a2c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5db5 expref: 22 pid: 10111 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.088870:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5db5 expref: 22 pid: 10111 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.088891:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a2c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5db5 expref: 22 pid: 10111 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.088905:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:1.0:1789302309.088910:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.088919:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.088927:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302309.088960:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302309.089009:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c76ee310-c3b4-4286-aaea-77936c269d98+21:2398:x1876219101554048:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 186us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302309.089017:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 105 00010000:00010000:0.0:1789302309.089147:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.089154:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302309.089256:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1789302309.089358:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:0.0:1789302309.089391:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1789302309.089458:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6532:1876219121527936:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789302309.089506:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302309.089543:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789302309.090211:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121527936 00000100:00100000:1.0:1789302309.090219:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121527936 00000100:00100000:1.0:1789302309.090260:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789302309.090268:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6532:x1876219121527936:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789302309.090356:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6532:x1876219121527936:12345-0@lo:1000:mdt00_002.0 Request processed in 88us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302309.090376:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789302309.090452:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6532:1876219121527936:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789302309.090582:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:3.0:1789302309.090631:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6532:1876219121528064:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789302309.090661:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302309.090689:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383996d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302309.090886:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121528064 00000100:00100000:1.0:1789302309.090891:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121528064 00000100:00100000:1.0:1789302309.090922:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789302309.090930:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6532:x1876219121528064:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789302309.091049:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6532:x1876219121528064:12345-0@lo:1000:mdt00_002.0 Request processed in 110us (376us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789302309.091056:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789302309.091185:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6532:1876219121528064:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789302309.091215:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091225:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091232:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091238:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311d400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302309.091242:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091264:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091278:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:3.0:1789302309.091281:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302309.091286:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091292:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d400/0x1ff82925bd39a315 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091314:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091321:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091326:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091331:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311da00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302309.091334:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091340:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091348:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302309.091350:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302309.091356:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a25f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d99 expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091379:0:6532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a25f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d99 expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091387:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a25f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d99 expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.091412:0:6532:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a25f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d99 expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.091424:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383804700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6532:1876219121528192:192.168.203.9@tcp:105: 00000100:00100000:3.0:1789302309.091481:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383996d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302309.095920:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302309.096031:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101554176 00000100:00100000:1.0:1789302309.096048:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101554176 00000100:00100000:1.0:1789302309.096101:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:1.0:1789302309.096139:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+25:12460:x1876219101554176:12345-192.168.203.9@tcp:49:lfs.0 00000100:00100000:1.0:1789302309.096261:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+25:12460:x1876219101554176:12345-192.168.203.9@tcp:49:lfs.0 Request processed in 151us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302309.096268:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:3.0:1789302309.096798:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383804700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6532:1876219121528192:192.168.203.9@tcp:105: 00010000:00010000:3.0:1789302309.096829:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096839:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311da00/0x1ff82925bd39a258 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096870:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a31c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096882:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a31c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096893:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a31c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096902:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a31c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096921:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a31c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096928:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a31c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096935:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302309.096939:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a31c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096947:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a31c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096969:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302309.096972:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302309.096975:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a31c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096980:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a31c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096991:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.096998:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.097004:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.097008:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311d200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302309.097017:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.097023:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.097031:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302309.097033:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789302309.097045:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.097052:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48311d200/0x1ff82925bd39a30e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.097200:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+24:12461:x1876219101553792:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 18216us (18422us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789302309.097209:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 246 00000020:00080000:3.0:1789302309.097213:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789302309.097379:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302309.097384:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302309.097909:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789302309.097917:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789302309.104994:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302309.105086:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101554432 00000100:00100000:1.0:1789302309.105097:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101554432 00000100:00100000:1.0:1789302309.105181:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 247 00000100:00100000:1.0:1789302309.105190:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+24:12460:x1876219101554432:12345-192.168.203.9@tcp:58:lfs.0 00000040:00080000:1.0:1789302309.105353:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789302309.105427:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+24:12460:x1876219101554432:12345-192.168.203.9@tcp:58:lfs.0 Request processed in 237us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302309.105435:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 247 00000100:00100000:1.0:1789302309.119216:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302309.119298:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101554688 00000100:00100000:3.0:1789302309.119307:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101554688 00000100:00100000:3.0:1789302309.119362:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 62 00000100:00100000:3.0:1789302309.119372:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+24:12461:x1876219101554688:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789302309.119627:0:6533:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789302309.119664:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1789302309.119720:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a323 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.119736:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a323 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.119747:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a323 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.119763:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a323 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.119770:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a323 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.119777:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a323 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.119889:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302309.119925:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302309.119932:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a323 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.119939:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302309.119943:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a323 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.120012:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+26:12461:x1876219101554688:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 641us (803us total) trans 4294967517 rc 0/0 00010000:00010000:0.0:1789302309.120013:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a323 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302309.120021:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 62 00010000:00010000:0.0:1789302309.120025:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00000020:00080000:3.0:1789302309.120026:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789302309.120028:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789302309.120033:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a323 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.120048:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a323 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.120059:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302309.120060:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302309.120062:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302309.132054:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302309.132221:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101554816 00000100:00100000:2.0:1789302309.132236:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101554816 00000100:00100000:2.0:1789302309.132299:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 248 00000100:00100000:2.0:1789302309.132309:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+26:12463:x1876219101554816:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302309.132329:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302309.132348:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a32a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5dd1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.132420:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a331 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.132436:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a331 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.132448:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a331 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.132482:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a338 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.132490:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a338 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.132497:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a338 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.132885:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.132897:0:6530:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d92 expref: 27 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.132906:0:6530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.132944:0:6530:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d92 expref: 27 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302309.132959:0:6530:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d92 expref: 27 pid: 10111 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302309.132973:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a28000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6530:1876219121528320:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302309.133103:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484ed2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302309.155951:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302309.156065:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a28000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6530:1876219121528320:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302309.156094:0:6530:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.156196:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101555072 00000100:00100000:0.0:1789302309.156203:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101555072 00000100:00100000:0.0:1789302309.156295:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:0.0:1789302309.156306:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+28:6166:x1876219101555072:12345-192.168.203.9@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789302309.156532:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+29:6166:x1876219101555072:12345-192.168.203.9@tcp:35:ldlm_bl.0 Request processed in 228us (589us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789302309.156540:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:1.0:1789302309.167833:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302309.167909:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101555200 00000100:00100000:0.0:1789302309.167921:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101555200 00010000:00010000:0.0:1789302309.167962:0:13201:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d92 expref: 29 pid: 10111 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302309.168004:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 106 00000100:00100000:0.0:1789302309.168015:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+29:2398:x1876219101555200:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302309.168028:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302309.168035:0:13201:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d92 expref: 29 pid: 10111 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.168064:0:13201:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d92 expref: 29 pid: 10111 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.168088:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39a24a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d92 expref: 29 pid: 10111 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.168103:0:13201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:0.0:1789302309.168108:0:13201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.168178:0:13201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.168186:0:13201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302309.168228:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302309.168285:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c76ee310-c3b4-4286-aaea-77936c269d98+28:2398:x1876219101555200:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 271us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302309.168294:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 106 00010000:00010000:3.0:1789302309.168306:0:6530:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.168319:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302309.168366:0:6530:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789302309.168371:0:6530:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302309.168390:0:6530:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.168414:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.168424:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a331 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.168432:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a331 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.168439:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a331 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.168444:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302309.168448:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a331 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.168455:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a331 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.168463:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302309.168466:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302309.168469:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a331 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.168475:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349e00/0x1ff82925bd39a331 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.168487:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a338 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.168494:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a338 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.169317:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a338 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.169326:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302309.169330:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a338 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.169338:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a338 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.169349:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cc4adc10800) 00010000:00010000:3.0:1789302309.169351:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302309.169355:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a338 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.169361:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39a338 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.169401:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348600/0x1ff82925bd39a32a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dd1 expref: 28 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.169411:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dd1 expref: 27 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302309.169416:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302309.169417:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302309.169419:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348e00, rc 0) 00000100:00100000:2.0:1789302309.169555:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+27:12463:x1876219101554816:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 37201us (37475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302309.169577:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 248 00010000:00010000:2.0:1789302309.270580:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302309.460331:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121528448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302309.460410:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302309.460528:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121528448 00000100:00100000:1.0:1789302309.460541:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121528448 00000100:00100000:1.0:1789302309.460588:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789302309.460596:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876219121528448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302309.460618:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789302309.460670:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876219121528448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302309.460676:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789302309.460878:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121528448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302309.463328:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121528576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302309.463392:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302309.463495:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121528576 00000100:00100000:1.0:1789302309.463502:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121528576 00000100:00100000:1.0:1789302309.463560:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789302309.463569:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121528576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789302309.463589:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789302309.463632:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121528576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302309.463639:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1789302309.463700:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302309.463732:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121528576:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1789302309.931715:0:14677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789302309.931725:0:14677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789302309.931761:0:14677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789302309.931767:0:14677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789302310.106360:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302310.106368:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302310.106402:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789302310.106409:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789302310.106540:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121528704:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789302310.106625:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302310.119372:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302310.119411:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101555328 00000100:00100000:1.0:1789302310.119420:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101555328 00000100:00100000:1.0:1789302310.119476:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 249 00000100:00100000:1.0:1789302310.119485:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+28:12475:x1876219101555328:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789302310.119517:0:6532:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789302310.119624:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+28:12475:x1876219101555328:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 140us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302310.119632:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 249 00000100:00080000:1.0:1789302310.119652:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302310.120191:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1876219121528704:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789302310.129198:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302310.130096:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101555584 00000100:00100000:3.0:1789302310.130106:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101555584 00000100:00100000:3.0:1789302310.130176:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 250 00000100:00100000:3.0:1789302310.130187:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+27:12475:x1876219101555584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302310.130205:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302310.130224:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a346 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5dd8 expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.130395:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a34d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.130410:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a34d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.130423:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a34d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302310.130434:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789302310.130537:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a346 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dd8 expref: 30 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.130557:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a34d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dd8 expref: 29 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.130566:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302310.130578:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302310.130583:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983a00, rc 0) 00000100:00100000:3.0:1789302310.130643:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c76ee310-c3b4-4286-aaea-77936c269d98+29:12475:x1876219101555584:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 458us (1453us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789302310.130652:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 250 00000100:00100000:1.0:1789302310.139053:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302310.139537:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101555712 00000100:00100000:0.0:1789302310.139547:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101555712 00000100:00100000:0.0:1789302310.139604:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00100000:0.0:1789302310.139615:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+29:2399:x1876219101555712:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302310.139630:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302310.139653:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a34d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dd8 expref: 29 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302310.139671:0:10408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:0.0:1789302310.139685:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302310.139746:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c76ee310-c3b4-4286-aaea-77936c269d98+28:2399:x1876219101555712:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 133us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302310.139755:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00100000:3.0:1789302310.140038:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302310.140106:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101555968 00000100:00100000:3.0:1789302310.140132:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101555968 00000100:00100000:3.0:1789302310.140164:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 251 00000100:00100000:3.0:1789302310.140172:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+28:12475:x1876219101555968:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789302310.140487:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a35b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.140502:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a35b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.140513:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a35b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.140681:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a35b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.140690:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a35b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.140697:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a35b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.140704:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302310.140708:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a35b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.140732:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a35b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.140743:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302310.140746:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789302310.140750:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a35b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302310.140757:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a35b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302310.140843:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+29:12475:x1876219101555968:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 670us (822us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789302310.140851:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 251 00000040:00080000:3.0:1789302310.140986:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302310.140991:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302310.141917:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789302310.141926:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789302310.142468:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302310.142532:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101556224 00000100:00100000:1.0:1789302310.142550:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101556224 00000100:00100000:1.0:1789302310.142597:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 64 00000100:00100000:1.0:1789302310.142607:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+29:12475:x1876219101556224:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789302310.142869:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+30:12475:x1876219101556224:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 262us (403us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789302310.142877:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 64 00010000:00010000:1.0:1789302310.294678:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302310.997190:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302310.997213:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121528832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302310.997281:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302310.997345:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121528960:0@lo:400:kworker.0 00000100:00100000:0.0:1789302310.997359:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121529088:0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997373:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302310.997396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121529472:0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997418:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302310.997437:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121529984:0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997474:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302310.997493:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789302310.997499:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121529344:0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997518:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302310.997534:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121529856:0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997554:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302310.997566:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121528832 00000100:00100000:3.0:1789302310.997568:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121530368:0@lo:400:kworker.0 00000100:00100000:1.0:1789302310.997573:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121528832 00000100:00100000:3.0:1789302310.997584:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302310.997609:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121528960 00000100:00100000:3.0:1789302310.997613:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121528960 00000100:00100000:1.0:1789302310.997615:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789302310.997634:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121528832:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302310.997637:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789302310.997642:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121528960:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1789302310.997664:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302310.997679:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3648:x1876219121528960:12345-0@lo:400:kworker.0 Request processed in 37us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302310.997686:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1789302310.997693:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121528832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302310.997699:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789302310.997715:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121529472 00000100:00100000:3.0:1789302310.997718:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121529472 00000100:00100000:1.0:1789302310.997742:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121529216:0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997749:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121529984 00000100:00100000:3.0:1789302310.997751:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121529984 00000100:00100000:1.0:1789302310.997766:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302310.997768:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121529344 00000100:00100000:3.0:1789302310.997770:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121529344 00000100:00100000:3.0:1789302310.997783:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789302310.997783:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121529728:0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997789:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121529472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302310.997802:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302310.997814:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121529472:12345-0@lo:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302310.997815:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121530240:0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997820:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789302310.997832:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789302310.997833:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302310.997844:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121529984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302310.997856:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121529216 00000100:00100000:1.0:1789302310.997860:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121529216 00000100:00100000:3.0:1789302310.997871:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121529984:12345-0@lo:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302310.997877:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789302310.997879:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789302310.997885:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121529216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997887:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789302310.997892:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121529344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997913:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121529344:12345-0@lo:400:kworker.0 Request processed in 21us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302310.997913:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121529216:12345-0@lo:400:kworker.0 Request processed in 28us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302310.997918:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789302310.997924:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:3.0:1789302310.997936:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302310.997951:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121529216:0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997956:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121529344:0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997963:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121528960:0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.997971:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121529472:0@lo:400:kworker.0 00000100:00100000:1.0:1789302310.997978:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121529856 00000100:00100000:3.0:1789302310.997979:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121529984:0@lo:400:kworker.0 00000100:00100000:1.0:1789302310.997981:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121529856 00000100:00100000:3.0:1789302310.997991:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121528832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302310.998003:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121530368 00000100:00100000:1.0:1789302310.998005:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121530368 00000100:00100000:1.0:1789302310.998016:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121529728 00000100:00100000:1.0:1789302310.998018:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121529728 00000100:00100000:3.0:1789302310.998035:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121530240 00000100:00100000:3.0:1789302310.998038:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121530240 00000100:00100000:1.0:1789302310.998041:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789302310.998046:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1876219121529856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.998061:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789302310.998090:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1876219121529856:12345-0@lo:400:kworker.0 Request processed in 42us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302310.998095:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789302310.998106:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789302310.998132:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121529728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302310.998163:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121529728:12345-0@lo:400:kworker.0 Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302310.998168:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789302310.998179:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789302310.998230:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121530368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302310.998263:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121530368:12345-0@lo:400:kworker.0 Request processed in 196us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302310.998347:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302310.999077:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121530240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302310.999137:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121530240:12345-0@lo:400:kworker.0 Request processed in 65us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302310.999713:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121529600:0@lo:400:kworker.0 00000100:00100000:0.0:1789302310.999760:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302310.999787:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121530112:0@lo:400:kworker.0 00000100:00100000:0.0:1789302310.999806:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302310.999846:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121529088 00000100:00100000:0.0:1789302310.999852:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121529088 00000100:00100000:0.0:1789302310.999885:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121529600 00000100:00100000:0.0:1789302310.999888:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121529600 00000100:00100000:0.0:1789302310.999907:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121530112 00000100:00100000:0.0:1789302310.999910:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121530112 00000100:00100000:0.0:1789302310.999927:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789302310.999934:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121529088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302310.999969:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121529088:12345-0@lo:400:kworker.0 Request processed in 36us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302310.999976:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789302310.999991:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789302310.999996:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121529600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302311.000022:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121529600:12345-0@lo:400:kworker.0 Request processed in 26us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302311.000039:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789302311.000063:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789302311.000069:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121530112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302311.000168:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121530112:12345-0@lo:400:kworker.0 Request processed in 98us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302311.000174:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789302311.000218:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121529088:0@lo:400:kworker.0 00010000:00080000:0.0:1789302311.000231:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc3843ef480 x1876219121529600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302311.000242:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121529600:0@lo:400:kworker.0 00010000:00080000:0.0:1789302311.000251:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4a7f09180 x1876219121530112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302311.000259:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121530112:0@lo:400:kworker.0 00000100:00100000:0.0:1789302311.000306:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121529728:0@lo:400:kworker.0 00000100:00100000:0.0:1789302311.000317:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121530240:0@lo:400:kworker.0 00000100:00080000:0.0:1789302311.000364:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302311.000381:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302311.000404:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121529856:0@lo:400:kworker.0 00000100:00100000:0.0:1789302311.000417:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121530368:0@lo:400:kworker.0 00000100:00100000:3.0:1789302311.001226:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789302311.001441:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000040:00080000:3.0:1789302311.188260:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302311.188269:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302311.188358:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789302311.188365:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789302311.316622:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302311.508358:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302311.508381:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121530496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302311.508443:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302311.508511:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121530496 00000100:00100000:1.0:1789302311.508518:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121530496 00000100:00100000:2.0:1789302311.508741:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121530624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302311.508770:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302311.508829:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121530624 00000100:00100000:3.0:1789302311.508833:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121530624 00000100:00100000:3.0:1789302311.508896:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789302311.508906:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876219121530624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302311.508931:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789302311.508977:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876219121530624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302311.508984:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789302311.509037:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121530624:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789302311.509081:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302311.509339:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789302311.509346:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121530496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302311.509357:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302311.509429:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121530496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302311.509436:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789302311.510705:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121530496:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1789302311.768480:0:14728:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302311.768489:0:14728:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302311.768521:0:14728:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789302311.768527:0:14728:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789302311.833141:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789302312.003692:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302312.006652:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101556480 00000100:00100000:3.0:1789302312.006666:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101556480 00000100:00100000:3.0:1789302312.006736:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 252 00000100:00100000:3.0:1789302312.006748:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+30:12496:x1876219101556480:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302312.006772:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302312.006792:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a362 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ddf expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.006903:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a369 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.006918:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a369 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.006932:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a369 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302312.006945:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789302312.007069:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a362 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ddf expref: 33 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.007092:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a369 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ddf expref: 32 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.007100:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302312.007103:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789302312.007107:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982e00, rc 0) 00000100:00100000:3.0:1789302312.007184:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+32:12496:x1876219101556480:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 438us (3500us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789302312.007192:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 252 00000100:00080000:3.0:1789302312.007217:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302312.013293:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302312.013324:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101556608 00000100:00100000:3.0:1789302312.013332:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101556608 00000100:00100000:3.0:1789302312.013375:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 253 00000100:00100000:3.0:1789302312.013384:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+32:12496:x1876219101556608:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:3.0:1789302312.013450:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a377 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.013467:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.013479:0:6530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.013514:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.013533:0:6530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a377 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.013540:0:6530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.013546:0:6530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302312.013551:0:6530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.013558:0:6530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a377 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.013570:0:6530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302312.013573:0:6530:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302312.013578:0:6530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a377 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302312.013585:0:6530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983600/0x1ff82925bd39a377 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6530 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302312.013658:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+32:12496:x1876219101556608:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 274us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302312.013666:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 253 00000100:00100000:2.0:1789302312.032081:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302312.032106:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121530752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302312.032198:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302312.032522:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121530752 00000100:00100000:1.0:1789302312.032531:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121530752 00000100:00100000:1.0:1789302312.032618:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789302312.032627:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121530752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789302312.032661:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789302312.032803:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121530752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 177us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302312.032812:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789302312.032891:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121530752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302312.146786:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302312.146943:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101556736 00000100:00100000:0.0:1789302312.146953:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101556736 00000100:00100000:0.0:1789302312.147034:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 79 00000100:00100000:0.0:1789302312.147044:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+7:2396:x1876219101556736:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:0.0:1789302312.147060:0:14588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302312.147081:0:14588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a37e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5de6 expref: -99 pid: 14588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302312.147107:0:14588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa69624, atime: 0x6aa69623, ctime: 0x6aa69624, blocks: 0x8 00010000:00010000:0.0:1789302312.147173:0:14588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1789302312.147178:0:14588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302312.147187:0:14588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a37e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5de6 expref: 8 pid: 14588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302312.147203:0:14588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a37e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5de6 expref: 8 pid: 14588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302312.147216:0:14588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311de00, rc 0) 00000100:00100000:0.0:1789302312.147270:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c76ee310-c3b4-4286-aaea-77936c269d98+8:2396:x1876219101556736:12345-192.168.203.9@tcp:101:cat.0 Request processed in 227us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302312.147277:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 79 00000100:00080000:3.0:1789302312.147336:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302312.152343:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302312.152475:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101556864 00000100:00100000:0.0:1789302312.152484:0:8452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101556864 00002000:00100000:0.0:1789302312.152529:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8cc38489f800 x1876219101556864/t0(0) o3->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:643/0 lens 488/0 e 0 to 0 dl 1789302323 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789302312.152540:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc38489f800 with x1876219101556864 ext(0->4095) 00002000:00010000:0.0:1789302312.152557:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc38489f800 00000100:00100000:0.0:1789302312.152591:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:0.0:1789302312.152601:0:8452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+8:2397:x1876219101556864:12345-192.168.203.9@tcp:3:cat.0 00000100:00100000:0.0:1789302312.152763:0:8452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c76ee310-c3b4-4286-aaea-77936c269d98+8:2397:x1876219101556864:12345-192.168.203.9@tcp:3:cat.0 Request processed in 163us (428us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789302312.152771:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 7 00002000:00100000:0.0:1789302312.152778:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8cc38489f800 x1876219101556864/t0(0) o3->c76ee310-c3b4-4286-aaea-77936c269d98@192.168.203.9@tcp:643/0 lens 488/4536 e 0 to 0 dl 1789302323 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789302312.152786:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc38489f800 with x1876219101556864 ext(0->4095) 00002000:00010000:0.0:1789302312.152789:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cc38489f800 00000100:00100000:1.0:1789302312.296359:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302312.296401:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302312.296491:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101556992 00000100:00100000:3.0:1789302312.296512:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101556992 00000100:00100000:3.0:1789302312.296564:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 398 00000100:00100000:3.0:1789302312.296574:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101556992:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302312.296646:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2396:x1876219101556992:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302312.296653:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 398 00000100:00100000:0.0:1789302312.297082:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101557248 00000100:00100000:0.0:1789302312.297086:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101557248 00000100:00100000:3.0:1789302312.297145:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00080000:2.0:1789302312.297231:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302312.297303:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302312.297474:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101557504 00000100:00100000:0.0:1789302312.297474:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101557120 00000100:00100000:1.0:1789302312.297479:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101557504 00000100:00100000:0.0:1789302312.297479:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101557120 00000100:00100000:1.0:1789302312.297506:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 358 00000100:00100000:0.0:1789302312.297511:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 359 00000100:00100000:1.0:1789302312.297514:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101557248:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302312.297516:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+32:2396:x1876219101557120:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302312.297555:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101557248:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 41us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302312.297555:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+32:2396:x1876219101557120:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 37us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302312.297562:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 359 00000100:00100000:3.0:1789302312.297591:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302312.297641:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302312.297688:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101557632 00000100:00100000:3.0:1789302312.297691:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101557632 00000100:00100000:1.0:1789302312.297876:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 358 00000100:00100000:0.0:1789302312.297889:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 360 00000100:00100000:0.0:1789302312.297896:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101557504:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302312.297941:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101557504:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 45us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302312.297947:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 360 00000100:00100000:0.0:1789302312.297959:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 361 00000100:00100000:0.0:1789302312.297975:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101557632:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302312.298000:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2396:x1876219101557632:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302312.298006:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 361 00000100:00100000:2.0:1789302312.298007:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101557376 00000100:00100000:2.0:1789302312.298010:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101557376 00000100:00100000:2.0:1789302312.298057:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 171 00000100:00100000:2.0:1789302312.298064:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101557376:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302312.298090:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2396:x1876219101557376:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302312.298097:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 171 00000100:00080000:0.0:1789302312.298359:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302312.298363:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302312.298365:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789302312.340378:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302313.364405:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302314.390413:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302314.580340:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121530880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302314.580417:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302314.580474:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121530880 00000100:00100000:1.0:1789302314.580482:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121530880 00000100:00100000:1.0:1789302314.580542:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789302314.580553:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121530880:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789302314.580561:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789302314.580582:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789302314.581486:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121530880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 932us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302314.581496:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789302314.581500:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121530880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302314.588462:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121531008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302314.588658:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302314.588900:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121531008 00000100:00100000:3.0:1789302314.588908:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121531008 00000100:00100000:3.0:1789302314.588962:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789302314.588971:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121531008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789302314.588992:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789302314.589042:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121531008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302314.589049:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789302314.589091:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121531008:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789302314.589636:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789302315.096474:0:9525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1789302315.099853:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1789302315.099898:0:6509:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cc383996300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789302315.099905:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc488c33700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cc383996840 00000020:00080000:0.0:1789302315.100519:0:6509:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cc488c33a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cc488c14400 00000020:00080000:0.0:1789302315.100620:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1789302315.100847:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302315.100859:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302315.100867:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302315.100873:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302315.100877:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302315.100886:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302315.100904:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cc4adc10400) 00010000:00010000:0.0:1789302315.101518:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302315.101526:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302315.102063:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983800/0x1ff82925bd39a2f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10111 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789302315.102099:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789302315.102193:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1789302315.104624:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1789302315.104638:0:8439:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:2.0:1789302315.413336:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302316.116863:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121531136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302316.116934:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302316.118874:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121531136 00000100:00100000:2.0:1789302316.118885:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121531136 00000100:00100000:2.0:1789302316.118937:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789302316.119172:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121531136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302316.119209:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789302316.119869:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302316.119880:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121531264:0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.120189:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121531392:0@lo:400:kworker.0 00000100:00100000:0.0:1789302316.120460:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121531776:0@lo:400:kworker.0 00000100:00100000:3.0:1789302316.121102:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302316.121159:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121531648:0@lo:400:kworker.0 00000100:00100000:3.0:1789302316.121185:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302316.121206:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121532160:0@lo:400:kworker.0 00000100:00100000:3.0:1789302316.121229:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302316.121836:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302316.121856:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121531904:0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.121876:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302316.121892:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121532416:0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.121911:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302316.121932:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789302316.121939:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121531520:0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.121973:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302316.122001:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121532032:0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122022:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302316.122039:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121532544:0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122054:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302316.122086:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121532160 00000100:00100000:1.0:1789302316.122105:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121532160 00000100:00100000:1.0:1789302316.122162:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121532032 00000100:00100000:1.0:1789302316.122165:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121532032 00000100:00100000:1.0:1789302316.122179:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121532544 00000100:00100000:1.0:1789302316.122181:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121532544 00000100:00100000:1.0:1789302316.122196:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789302316.122204:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121532160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122257:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121532160:12345-0@lo:400:kworker.0 Request processed in 53us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.122263:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789302316.122277:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789302316.122282:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121532032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122308:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121532032:12345-0@lo:400:kworker.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.122314:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789302316.122323:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789302316.122328:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121532544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122349:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121532544:12345-0@lo:400:kworker.0 Request processed in 22us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.122354:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789302316.122380:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121531520 00000100:00100000:1.0:1789302316.122383:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121531520 00000100:00100000:1.0:1789302316.122407:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789302316.122412:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121531520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122440:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121531520:12345-0@lo:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.122445:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1789302316.122467:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302316.122471:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302316.122507:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121531520:0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122519:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121532032:0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122527:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121532544:0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122571:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121531648 00000100:00100000:1.0:1789302316.122574:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121531648 00000100:00100000:1.0:1789302316.122596:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789302316.122602:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121531648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122644:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121531648:12345-0@lo:400:kworker.0 Request processed in 42us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.122650:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789302316.122660:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121531392 00000100:00100000:1.0:1789302316.122663:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121531392 00000100:00100000:1.0:1789302316.122675:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121531904 00000100:00100000:1.0:1789302316.122678:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121531904 00000100:00100000:1.0:1789302316.122706:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121532416 00000100:00100000:1.0:1789302316.122716:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121532416 00000100:00100000:1.0:1789302316.122731:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789302316.122736:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121531392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122765:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121531392:12345-0@lo:400:kworker.0 Request processed in 29us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.122770:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789302316.122781:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789302316.122786:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121531904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122807:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121531904:12345-0@lo:400:kworker.0 Request processed in 22us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.122818:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789302316.122828:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789302316.122833:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121532416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.122857:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121532416:12345-0@lo:400:kworker.0 Request processed in 25us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.122862:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00080000:1.0:1789302316.122879:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789302316.122895:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121531392:0@lo:400:kworker.0 00010000:00080000:1.0:1789302316.122905:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc3843efb80 x1876219121531904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302316.122915:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121531904:0@lo:400:kworker.0 00010000:00080000:1.0:1789302316.122924:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc3843ed880 x1876219121532416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302316.122931:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121532416:0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.123000:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121531264 00000100:00100000:1.0:1789302316.123004:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121531264 00000100:00100000:1.0:1789302316.123028:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789302316.123034:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121531264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.123060:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121531264:12345-0@lo:400:kworker.0 Request processed in 27us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.123066:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1789302316.125166:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121531136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6202us (8223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302316.125181:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789302316.136387:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302316.136446:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121532288:0@lo:400:kworker.0 00000100:00100000:0.0:1789302316.136483:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302316.138075:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121531776 00000100:00100000:1.0:1789302316.138086:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121531776 00000100:00100000:1.0:1789302316.138172:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121532288 00000100:00100000:1.0:1789302316.138189:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121532288 00000100:00100000:1.0:1789302316.138217:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1789302316.138344:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789302316.138350:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cc383a2b800, transno 4294967323 00000004:00080000:3.0:1789302316.138362:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1789302316.138734:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121531776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.138801:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121531776:12345-0@lo:400:kworker.0 Request processed in 72us (2421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.138809:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789302316.138827:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789302316.138833:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121532288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.138861:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121532288:12345-0@lo:400:kworker.0 Request processed in 28us (2377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.138867:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789302316.138980:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121532160:0@lo:400:kworker.0 00000100:00100000:3.0:1789302316.138999:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121532672:0@lo:400:kworker.0 00000100:00100000:3.0:1789302316.139032:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789302316.139133:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302316.139160:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121531776:0@lo:400:kworker.0 00000100:00100000:0.0:1789302316.139172:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121532288:0@lo:400:kworker.0 00000100:00100000:3.0:1789302316.144217:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121531264:0@lo:400:kworker.0 00000100:00100000:3.0:1789302316.144257:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121531136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302316.144300:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121531648:0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.149632:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121532672 00000100:00100000:1.0:1789302316.149646:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121532672 00000100:00080000:0.0:1789302316.149709:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302316.149777:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789302316.149788:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121532672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302316.149907:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121532672:12345-0@lo:400:kworker.0 Request processed in 112us (10865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302316.149915:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789302316.150060:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789302316.150066:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cc38489c700, transno 4294967311 00000100:00100000:0.0:1789302316.150081:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121532672:0@lo:400:kworker.0 00010000:00010000:1.0:1789302316.436404:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302316.628408:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302316.628433:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121532800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302316.628507:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302316.628818:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121532928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302316.628851:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302316.628947:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121532800 00000100:00100000:0.0:1789302316.628955:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121532800 00000100:00100000:2.0:1789302316.628977:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121532928 00000100:00100000:2.0:1789302316.628993:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121532928 00000100:00100000:0.0:1789302316.629174:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789302316.629185:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121532800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302316.629213:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302316.629255:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121532800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302316.629277:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789302316.629292:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789302316.629297:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121532928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302316.629306:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302316.629334:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121532928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302316.629339:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789302316.629425:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121532928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302316.629456:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121532800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302317.140641:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302317.140663:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121533056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302317.140730:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302317.140795:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121533056 00000100:00100000:2.0:1789302317.140802:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121533056 00000100:00100000:2.0:1789302317.140868:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789302317.140877:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121533056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302317.140909:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789302317.141278:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121533056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302317.141287:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789302317.141335:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121533056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302317.423321:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302317.423354:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101557760 00000100:00100000:2.0:1789302317.423363:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101557760 00000100:00100000:2.0:1789302317.423421:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 400 00000100:00100000:2.0:1789302317.423431:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101557760:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302317.423497:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101557760:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302317.423504:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 400 00000100:00100000:2.0:1789302317.423548:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302317.423792:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302317.423953:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302317.423989:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302317.424014:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302317.424034:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302317.424203:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101558272 00000100:00100000:2.0:1789302317.424209:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101558272 00000100:00100000:2.0:1789302317.424246:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101558144 00000100:00100000:2.0:1789302317.424249:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101558144 00000100:00100000:2.0:1789302317.424272:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 176 00000100:00100000:2.0:1789302317.424279:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101558272:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302317.424317:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101558272:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 38us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302317.424323:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 176 00000100:00100000:2.0:1789302317.424336:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 177 00000100:00100000:2.0:1789302317.424342:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101558144:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302317.424366:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101558144:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302317.424371:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 177 00000100:00100000:2.0:1789302317.424388:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101558016 00000100:00100000:2.0:1789302317.424398:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101558016 00000100:00100000:2.0:1789302317.424424:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101558528 00000100:00100000:2.0:1789302317.424427:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101558528 00000100:00100000:2.0:1789302317.424437:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101557888 00000100:00100000:2.0:1789302317.424440:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101557888 00000100:00100000:2.0:1789302317.424450:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101558400 00000100:00100000:2.0:1789302317.424452:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101558400 00000100:00100000:2.0:1789302317.424466:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 368 00000100:00100000:2.0:1789302317.424472:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101558016:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302317.424499:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101558016:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 27us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302317.424504:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 368 00000100:00100000:2.0:1789302317.424515:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 369 00000100:00100000:2.0:1789302317.424520:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101558528:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302317.424540:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101558528:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 20us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302317.424546:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 369 00000100:00100000:2.0:1789302317.424555:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 370 00000100:00100000:2.0:1789302317.424560:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+18:2398:x1876219101557888:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302317.424584:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+18:2398:x1876219101557888:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302317.424589:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 370 00000100:00100000:2.0:1789302317.424598:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 371 00000100:00100000:2.0:1789302317.424604:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101558400:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302317.424622:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101558400:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 19us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302317.424636:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 371 00000100:00080000:2.0:1789302317.426293:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302317.426305:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302317.426308:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302317.426311:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789302317.460291:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302317.877394:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302317.877522:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101558656 00000100:00100000:1.0:1789302317.877533:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101558656 00000100:00100000:1.0:1789302317.877593:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 254 00000100:00100000:1.0:1789302317.877603:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+18:12148:x1876219101558656:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789302317.877721:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+18:12148:x1876219101558656:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 Request processed in 119us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302317.877728:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 254 00000100:00100000:0.0:1789302317.893184:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302317.893689:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101558784 00000100:00100000:2.0:1789302317.893698:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101558784 00000100:00100000:2.0:1789302317.893765:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 255 00000100:00100000:2.0:1789302317.893774:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:12148:x1876219101558784:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789302317.893882:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:12148:x1876219101558784:12345-192.168.203.9@tcp:60:lhsmtool_posix.0 Request processed in 109us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302317.893896:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 255 00000100:00100000:3.0:1789302317.905353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302317.905455:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101559040 00000100:00100000:1.0:1789302317.905465:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101559040 00000100:00100000:1.0:1789302317.905529:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 65 00000100:00100000:1.0:1789302317.905539:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+18:12148:x1876219101559040:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789302317.905779:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+19:12148:x1876219101559040:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 242us (435us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789302317.905788:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 65 00010000:00010000:2.0:1789302318.484645:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302319.508594:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302319.700428:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302319.700460:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121533184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302319.700557:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302319.700742:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121533184 00000100:00100000:1.0:1789302319.700754:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121533184 00000100:00100000:1.0:1789302319.700830:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789302319.700843:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121533184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789302319.700878:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789302319.700932:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121533184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302319.700939:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1789302319.701004:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302319.701049:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121533184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302319.707187:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121533312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302319.707283:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302319.707374:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121533312 00000100:00100000:1.0:1789302319.707384:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121533312 00000100:00100000:1.0:1789302319.707448:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789302319.707459:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121533312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302319.707484:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789302319.707532:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121533312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302319.707540:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1789302319.707563:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302319.707606:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121533312:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789302320.390713:0:14925:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:25:18 (1789302318) 00010000:00010000:2.0:1789302320.541586:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789302320.734288:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1789302320.734317:0:6509:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789302320.734596:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789302320.734610:0:6562:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1789302321.044829:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789302321.237537:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302321.237555:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121533440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302321.237620:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302321.237705:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121533440 00000100:00100000:0.0:1789302321.237712:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121533440 00000100:00100000:0.0:1789302321.237750:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789302321.237756:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121533440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789302321.237783:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789302321.237821:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121533440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302321.237826:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789302321.237928:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121533440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302321.242356:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121533696:0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.242423:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302321.242478:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121534208:0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.242501:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302321.242521:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121533696 00000100:00100000:2.0:1789302321.242528:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121533696 00000100:00100000:0.0:1789302321.242532:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121534720:0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.242555:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302321.242576:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789302321.242578:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121534208 00000100:00100000:2.0:1789302321.242581:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121534208 00000100:00100000:0.0:1789302321.242583:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121533824:0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.242605:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302321.242626:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121534720 00000100:00100000:0.0:1789302321.242629:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121534336:0@lo:400:kworker.0 00000100:00100000:2.0:1789302321.242630:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121534720 00000100:00100000:2.0:1789302321.242654:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789302321.242654:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302321.242656:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121533952:0@lo:400:kworker.0 00000100:00100000:2.0:1789302321.242672:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121533696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.242680:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121534848:0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.242713:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302321.242724:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121533696:12345-0@lo:400:kworker.0 Request processed in 61us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302321.242742:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789302321.242758:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302321.242765:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789302321.242765:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121533696:0@lo:400:kworker.0 00000100:00080000:1.0:1789302321.242770:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789302321.242777:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121534208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302321.242790:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121533952 00000100:00100000:1.0:1789302321.242796:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121533952 00000100:00100000:0.0:1789302321.242819:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789302321.242829:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121534720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302321.242836:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121534464:0@lo:400:kworker.0 00000100:00100000:2.0:1789302321.242837:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121534208:12345-0@lo:400:kworker.0 Request processed in 63us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302321.242850:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789302321.242868:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121533952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.242868:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121534720:12345-0@lo:400:kworker.0 Request processed in 36us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302321.242881:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789302321.242907:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121533824 00000100:00100000:0.0:1789302321.242912:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121533824 00000100:00100000:1.0:1789302321.242928:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121533952:12345-0@lo:400:kworker.0 Request processed in 68us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302321.242937:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789302321.242943:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789302321.242962:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121533824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.242995:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121533824:12345-0@lo:400:kworker.0 Request processed in 45us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302321.243002:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789302321.243024:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121534336 00000100:00100000:0.0:1789302321.243028:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121534336 00000100:00100000:3.0:1789302321.243035:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789302321.243151:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302321.243170:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121534848 00000100:00100000:0.0:1789302321.243176:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121534848 00000100:00100000:3.0:1789302321.243190:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121534976:0@lo:400:kworker.0 00000100:00100000:3.0:1789302321.243227:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302321.243230:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121534464 00000100:00100000:0.0:1789302321.243236:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121534464 00000100:00100000:0.0:1789302321.243265:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121534976 00000100:00100000:0.0:1789302321.243269:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121534976 00000100:00100000:3.0:1789302321.243282:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121533952:0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.243292:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789302321.243301:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121534336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302321.243307:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789302321.243321:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121533568:0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.243351:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121534336:12345-0@lo:400:kworker.0 Request processed in 49us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302321.243360:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789302321.243376:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789302321.243383:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121534848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.243419:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121534848:12345-0@lo:400:kworker.0 Request processed in 37us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302321.243424:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789302321.243435:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789302321.243440:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121534464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.243465:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121534464:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302321.243470:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789302321.243481:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789302321.243486:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121534976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.243513:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121534976:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302321.243519:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789302321.243538:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789302321.243572:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121533824:0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.243590:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121534336:0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.243608:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121534848:0@lo:400:kworker.0 00010000:00080000:0.0:1789302321.243619:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383457100 x1876219121534208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302321.243630:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121534208:0@lo:400:kworker.0 00010000:00080000:0.0:1789302321.243639:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383456d80 x1876219121534720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302321.243647:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121534720:0@lo:400:kworker.0 00000100:00100000:3.0:1789302321.244064:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302321.244147:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121534080:0@lo:400:kworker.0 00000100:00100000:3.0:1789302321.244188:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302321.244206:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121534592:0@lo:400:kworker.0 00000100:00100000:3.0:1789302321.244227:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302321.244256:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121534464:0@lo:400:kworker.0 00000100:00100000:3.0:1789302321.244269:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121534976:0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.244378:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121534080 00000100:00100000:0.0:1789302321.244385:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121534080 00000100:00100000:0.0:1789302321.244416:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121534592 00000100:00100000:0.0:1789302321.244418:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121534592 00000100:00100000:0.0:1789302321.244438:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789302321.244445:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121534080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.244496:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121534080:12345-0@lo:400:kworker.0 Request processed in 51us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302321.244502:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789302321.244513:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789302321.244518:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121534592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.244540:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121534592:12345-0@lo:400:kworker.0 Request processed in 22us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302321.244546:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789302321.244681:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121534080:0@lo:400:kworker.0 00000100:00100000:0.0:1789302321.244698:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121534592:0@lo:400:kworker.0 00000100:00100000:2.0:1789302321.244738:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121533568 00000100:00100000:2.0:1789302321.244748:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121533568 00000100:00100000:2.0:1789302321.244801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789302321.244813:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121533568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302321.245020:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3647:x1876219121533568:12345-0@lo:400:kworker.0 Request processed in 209us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302321.245029:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789302321.245165:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121533568:0@lo:400:kworker.0 00000100:00080000:1.0:1789302321.245181:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302321.245190:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302321.245194:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1789302321.428317:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302321.428333:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302321.428498:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789302321.428506:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789302321.557307:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302321.748644:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121535232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302321.748753:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302321.748979:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121535232 00000100:00100000:0.0:1789302321.748991:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121535232 00000100:00100000:0.0:1789302321.749065:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789302321.749077:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121535232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302321.749143:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302321.749285:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121535232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 208us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302321.749295:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789302321.749569:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121535232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302321.750759:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121535104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302321.750833:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302321.751681:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121535104 00000100:00100000:0.0:1789302321.751694:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121535104 00000100:00100000:0.0:1789302321.751758:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789302321.751770:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121535104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302321.751799:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302321.751875:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121535104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302321.751893:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789302321.751958:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121535104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302322.271151:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121535360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302322.271219:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302322.271337:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121535360 00000100:00100000:3.0:1789302322.271345:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121535360 00000100:00100000:3.0:1789302322.271387:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789302322.271395:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc491340450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121535360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789302322.271445:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789302322.284750:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc491340450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121535360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 13346us (13522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302322.284763:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789302322.288600:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121535360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302322.520103:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302322.520179:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302322.520198:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302322.521790:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101559552 00000100:00100000:0.0:1789302322.521802:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101559552 00000100:00100000:0.0:1789302322.521867:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 182 00000100:00100000:0.0:1789302322.521876:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101559552:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302322.521959:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c76ee310-c3b4-4286-aaea-77936c269d98+7:2398:x1876219101559552:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 83us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302322.521966:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 182 00000100:00100000:3.0:1789302322.522967:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302322.522993:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302322.523053:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101559168 00000100:00100000:0.0:1789302322.523073:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101559168 00000100:00100000:0.0:1789302322.523131:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 402 00000100:00100000:0.0:1789302322.523140:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101559168:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:0.0:1789302322.523182:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101559168:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 43us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302322.523189:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 402 00000100:00080000:0.0:1789302322.529198:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302322.531206:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101559296 00000100:00100000:2.0:1789302322.531221:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101559296 00000100:00100000:1.0:1789302322.531541:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101559808 00000100:00100000:1.0:1789302322.531558:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101559808 00000100:00100000:3.0:1789302322.531992:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302322.532038:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302322.547496:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101559680 00000100:00100000:3.0:1789302322.547510:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101559680 00000100:00100000:3.0:1789302322.547570:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 183 00000100:00100000:3.0:1789302322.547580:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101559680:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302322.547671:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101559680:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 92us (15683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302322.548750:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 183 00000100:00100000:2.0:1789302322.551406:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101559936 00000100:00100000:0.0:1789302322.551406:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101559424 00000100:00100000:2.0:1789302322.551421:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101559936 00000100:00100000:0.0:1789302322.551421:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101559424 00000100:00100000:2.0:1789302322.555722:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 378 00000100:00100000:1.0:1789302322.555748:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 379 00000100:00100000:1.0:1789302322.555772:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101559808:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302322.555869:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101559808:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 111us (35667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302322.555877:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 379 00000100:00100000:1.0:1789302322.555993:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 380 00000100:00100000:1.0:1789302322.556002:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101559936:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302322.556030:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fadf847f-5c0c-4967-b509-d18868692ac4+5:2398:x1876219101559936:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 30us (23991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302322.556036:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 380 00000100:00100000:1.0:1789302322.556052:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 381 00000100:00100000:1.0:1789302322.556059:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101559424:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302322.556084:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c76ee310-c3b4-4286-aaea-77936c269d98+5:2398:x1876219101559424:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (33090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302322.556090:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 381 00000100:00100000:2.0:1789302322.556412:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+18:2398:x1876219101559296:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302322.556472:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c76ee310-c3b4-4286-aaea-77936c269d98+18:2398:x1876219101559296:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 65us (36377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302322.556479:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 378 00000100:00080000:2.0:1789302322.557259:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302322.557267:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302322.557270:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789302322.582462:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302323.135001:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302323.135215:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101560064 00000100:00100000:1.0:1789302323.135227:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101560064 00000100:00100000:1.0:1789302323.135295:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 256 00000100:00100000:1.0:1789302323.135306:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+5:13168:x1876219101560064:12345-192.168.203.9@tcp:101:lsof.0 00010000:00010000:1.0:1789302323.135325:0:9541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302323.135345:0:9541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a385 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ded expref: -99 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302323.135413:0:9541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a38c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302323.135439:0:9541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a38c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302323.135452:0:9541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a38c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302323.135501:0:9541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789302323.135506:0:9541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302323.135545:0:9541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a38c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302323.135571:0:9541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa600/0x1ff82925bd39a385 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ded expref: 7 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302323.135587:0:9541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a38c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ded expref: 6 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302323.135595:0:9541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc490721200) 00010000:00010000:1.0:1789302323.135598:0:9541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302323.135602:0:9541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aa800, rc 0) 00000100:00100000:1.0:1789302323.136327:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fadf847f-5c0c-4967-b509-d18868692ac4+6:13168:x1876219101560064:12345-192.168.203.9@tcp:101:lsof.0 Request processed in 1020us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302323.136336:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 256 00010000:00010000:2.0:1789302323.604495:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302324.629083:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302324.820515:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121535488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302324.820589:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302324.820667:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121535616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302324.820806:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302324.825432:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121535488 00000100:00100000:1.0:1789302324.825446:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121535488 00000100:00080000:0.0:1789302324.825554:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302324.826352:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121535616 00000100:00100000:1.0:1789302324.826360:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121535616 00000100:00100000:0.0:1789302324.826366:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789302324.826377:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121535488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302324.826409:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789302324.826485:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789302324.826487:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121535488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (5899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302324.826492:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121535616:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302324.826494:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00002000:00000024:1.0:1789302324.826514:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789302324.826546:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121535616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (5738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302324.826552:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1789302324.826561:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302324.826612:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121535488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302324.826688:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121535616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302325.328653:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302325.328918:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101560320 00000100:00100000:0.0:1789302325.328938:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101560320 00000100:00100000:0.0:1789302325.329048:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 66 00000100:00100000:0.0:1789302325.329060:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+18:13170:x1876219101560320:12345-192.168.203.9@tcp:35:umount.0 00000100:00100000:0.0:1789302325.329336:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+19:13170:x1876219101560320:12345-192.168.203.9@tcp:35:umount.0 Request processed in 278us (693us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789302325.329344:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 66 00000100:00080000:3.0:1789302325.329892:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302325.334665:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302325.334998:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101560576 00000100:00100000:0.0:1789302325.335012:0:6534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101560576 00000100:00100000:0.0:1789302325.335090:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 67 00000100:00100000:0.0:1789302325.335103:0:6534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+19:13170:x1876219101560576:12345-192.168.203.9@tcp:35:umount.0 00000100:00100000:0.0:1789302325.336289:0:6534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c76ee310-c3b4-4286-aaea-77936c269d98+20:13170:x1876219101560576:12345-192.168.203.9@tcp:35:umount.0 Request processed in 1180us (1630us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789302325.336303:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 67 00000100:00100000:2.0:1789302325.341386:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302325.341498:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101560832 00000100:00100000:1.0:1789302325.341507:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101560832 00000100:00100000:1.0:1789302325.341565:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 68 00000100:00100000:1.0:1789302325.341575:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+20:13170:x1876219101560832:12345-192.168.203.9@tcp:35:umount.0 00000100:00100000:1.0:1789302325.341980:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+21:13170:x1876219101560832:12345-192.168.203.9@tcp:35:umount.0 Request processed in 405us (602us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789302325.341988:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 68 00000100:00100000:3.0:1789302325.348075:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302325.348212:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101561088 00000100:00100000:1.0:1789302325.348221:0:6533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101561088 00000100:00100000:1.0:1789302325.348315:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 69 00000100:00100000:1.0:1789302325.348326:0:6533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+21:13170:x1876219101561088:12345-192.168.203.9@tcp:35:umount.0 00000100:00100000:1.0:1789302325.348619:0:6533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c76ee310-c3b4-4286-aaea-77936c269d98+22:13170:x1876219101561088:12345-192.168.203.9@tcp:35:umount.0 Request processed in 288us (546us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789302325.348627:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 69 00000100:00100000:3.0:1789302325.356218:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302325.356258:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302325.356321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302325.356404:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302325.356527:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101561600 00000100:00100000:3.0:1789302325.356537:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101561600 00000100:00100000:3.0:1789302325.356594:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 80 00000100:00100000:3.0:1789302325.356604:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+5:2395:x1876219101561600:12345-192.168.203.9@tcp:9:umount.0 00000020:00000080:3.0:1789302325.356646:0:8445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd39968f 00000100:00080000:3.0:1789302325.356656:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cc38401d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789302325.356700:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789302325.356966:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c76ee310-c3b4-4286-aaea-77936c269d98+2:2395:x1876219101561600:12345-192.168.203.9@tcp:9:umount.0 Request processed in 363us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302325.356973:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 80 00010000:00010000:3.0:1789302325.356998:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789302325.357005:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302325.357168:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101561216 00000100:00100000:2.0:1789302325.357174:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101561216 00000100:00100000:2.0:1789302325.357217:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101561472 00000100:00100000:2.0:1789302325.357220:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101561472 00000100:00100000:2.0:1789302325.357240:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101561344 00000100:00100000:2.0:1789302325.357243:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101561344 00000100:00100000:2.0:1789302325.357258:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:2.0:1789302325.357266:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60e561d9-781c-4e5b-be29-fcae8ab02e31+15:2398:x1876219101561216:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302325.357276:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302325.357292:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166f200/0x1ff82925bd399371 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5947 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302325.357310:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302325.357338:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60e561d9-781c-4e5b-be29-fcae8ab02e31+14:2398:x1876219101561216:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 72us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302325.357344:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:2.0:1789302325.357358:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:2.0:1789302325.357383:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60e561d9-781c-4e5b-be29-fcae8ab02e31+13:2398:x1876219101561472:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302325.357391:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302325.357399:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538fa00/0x1ff82925bd39958c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a20 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302325.357407:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302325.357424:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60e561d9-781c-4e5b-be29-fcae8ab02e31+12:2398:x1876219101561472:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 42us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302325.357429:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:2.0:1789302325.357442:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:2.0:1789302325.357449:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:2398:x1876219101561344:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302325.357456:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302325.357463:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538ea00/0x1ff82925bd3992b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5908 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302325.357470:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302325.357484:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2398:x1876219101561344:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 37us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302325.357489:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:3.0:1789302325.362254:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302325.362411:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101561984 00000100:00100000:0.0:1789302325.362420:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101561984 00000100:00100000:0.0:1789302325.362496:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 81 00000100:00080000:3.0:1789302325.362507:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302325.362508:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+7:2395:x1876219101561984:12345-192.168.203.9@tcp:9:umount.0 00000020:00000080:0.0:1789302325.362538:0:8852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd399905 00000020:00010000:0.0:1789302325.362545:0:8852:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cc38422f800: total 0 00000100:00080000:0.0:1789302325.362549:0:8852:0:(import.c:65:import_set_state_nolock()) ffff8cc38422e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789302325.362596:0:8852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:2.0:1789302325.362680:0:6518:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cc38422f800: total 0 00010000:00010000:2.0:1789302325.362721:0:6518:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cc38422f800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789302325.362767:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a37e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5de6 expref: 5 pid: 14588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302325.362795:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052ee90b2/0x1ff82925bd399cbd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c0a expref: 4 pid: 8852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302325.362827:0:6518:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cc38422f800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789302325.362840:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302325.362842:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302325.362843:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302325.362910:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c76ee310-c3b4-4286-aaea-77936c269d98+2:2395:x1876219101561984:12345-192.168.203.9@tcp:9:umount.0 Request processed in 405us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302325.363207:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 81 00000100:00100000:2.0:1789302325.371375:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302325.371461:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101563008 00000100:00100000:1.0:1789302325.371471:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101563008 00000100:00100000:1.0:1789302325.371529:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 257 00000100:00100000:1.0:1789302325.371540:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+22:2395:x1876219101563008:12345-192.168.203.9@tcp:39:umount.0 00000020:00000080:1.0:1789302325.371573:0:6532:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3992c2 00000020:00010000:1.0:1789302325.371590:0:6532:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cc3839b8000: total 0 00000100:00080000:1.0:1789302325.371595:0:6532:0:(import.c:65:import_set_state_nolock()) ffff8cc3839be000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789302325.371627:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1789302325.371770:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c76ee310-c3b4-4286-aaea-77936c269d98+21:2395:x1876219101563008:12345-192.168.203.9@tcp:39:umount.0 Request processed in 232us (404us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1789302325.371776:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 257 00000020:00010000:3.0:1789302325.371935:0:6519:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cc3839b8000: total 0 00010000:00010000:3.0:1789302325.372028:0:6519:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cc3839b8000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789302325.372061:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:3.0:1789302325.372065:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789302325.372073:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd3c00/0x1ff82925bd399665 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a4a expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372093:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302325.372101:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789302325.372107:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982a00/0x1ff82925bd399d34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c26 expref: 19 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372216:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302325.372219:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302325.372223:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39a33f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5dd1 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372238:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc486113700) 00010000:00010000:3.0:1789302325.372241:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302325.372244:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178400/0x1ff82925bd39960a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a35 expref: 17 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372262:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302325.372264:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302325.372268:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348800/0x1ff82925bd399c7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bf5 expref: 16 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372279:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302325.372281:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789302325.372284:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aae00/0x1ff82925bd399ca8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c03 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372295:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cc383960e00) 00010000:00010000:3.0:1789302325.372297:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789302325.372300:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983e00/0x1ff82925bd39a021 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5cff expref: 14 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372324:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cc488eac700) 00010000:00010000:3.0:1789302325.372326:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789302325.372330:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4addd2800/0x1ff82925bd399960 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5b23 expref: 13 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372344:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc490721200) 00010000:00010000:3.0:1789302325.372359:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302325.372363:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348200/0x1ff82925bd399d18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5c1f expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372374:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302325.372383:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789302325.372387:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982e00/0x1ff82925bd39a369 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ddf expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372402:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cc488eacc00) 00010000:00010000:3.0:1789302325.372405:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302325.372408:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983200/0x1ff82925bd399b9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5bbd expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372422:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cc486113200) 00010000:00010000:3.0:1789302325.372425:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302325.372428:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4c2178200/0x1ff82925bd3995ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a2e expref: 9 pid: 10111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372442:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cc383960700) 00010000:00010000:3.0:1789302325.372444:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302325.372454:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa000/0x1ff82925bd39a25f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5d99 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302325.372467:0:6519:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cc3839b8000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789302325.372482:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302325.372484:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302325.372486:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302325.381395:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302325.381756:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101563136 00000100:00100000:2.0:1789302325.381765:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101563136 00000100:00100000:2.0:1789302325.381842:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 258 00000100:00100000:2.0:1789302325.381853:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+5:2395:x1876219101563136:12345-192.168.203.9@tcp:39:umount.0 00000020:00000080:2.0:1789302325.381884:0:6531:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3992c9 00000100:00080000:2.0:1789302325.381903:0:6531:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7ef5800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789302325.381973:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:2.0:1789302325.382061:0:6531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789302325.382253:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c76ee310-c3b4-4286-aaea-77936c269d98+3:2395:x1876219101563136:12345-192.168.203.9@tcp:39:umount.0 Request processed in 402us (878us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789302325.382262:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 258 00010000:00010000:1.0:1789302325.383381:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302325.652363:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302326.356378:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121535744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302326.356461:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302326.356533:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121535744 00000100:00100000:3.0:1789302326.356541:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121535744 00000100:00100000:2.0:1789302326.358597:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121535872:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.358660:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302326.358696:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121536384:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.358722:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302326.358744:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121536896:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.358763:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302326.358782:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789302326.358787:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121536256:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.358901:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302326.358933:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121536768:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.358956:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302326.359047:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121537280:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.359069:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302326.359223:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121535872 00000100:00100000:2.0:1789302326.359231:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121535872 00000100:00100000:2.0:1789302326.359277:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789302326.359285:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121535872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.359337:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121535872:12345-0@lo:400:kworker.0 Request processed in 52us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302326.359344:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789302326.359375:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121536384 00000100:00100000:2.0:1789302326.359380:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121536384 00000100:00100000:2.0:1789302326.359412:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121536896 00000100:00100000:2.0:1789302326.359414:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121536896 00000100:00100000:2.0:1789302326.359430:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121536256 00000100:00100000:2.0:1789302326.359433:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121536256 00000100:00100000:2.0:1789302326.359444:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789302326.359450:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121536384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.359478:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121536384:12345-0@lo:400:kworker.0 Request processed in 28us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302326.359483:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789302326.359494:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789302326.359499:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121536896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.359523:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121536896:12345-0@lo:400:kworker.0 Request processed in 24us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302326.359536:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789302326.359548:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1789302326.359553:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121536256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.359578:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121536256:12345-0@lo:400:kworker.0 Request processed in 26us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302326.359584:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1789302326.359620:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121536256:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.359630:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121535872:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.359638:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121536384:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.359646:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121536896:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.359694:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121536768 00000100:00100000:2.0:1789302326.359698:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121536768 00000100:00100000:2.0:1789302326.359723:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121537280 00000100:00100000:2.0:1789302326.359726:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121537280 00000100:00100000:2.0:1789302326.359744:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789302326.359750:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121536768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.359783:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121536768:12345-0@lo:400:kworker.0 Request processed in 33us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302326.359789:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789302326.359800:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789302326.359806:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121537280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302326.360070:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121536128:0@lo:400:kworker.0 00000100:00100000:1.0:1789302326.360125:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789302326.361362:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302326.361368:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302326.361371:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302326.361399:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121536000:0@lo:400:kworker.0 00000100:00100000:0.0:1789302326.361507:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302326.361541:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121536512:0@lo:400:kworker.0 00000100:00100000:0.0:1789302326.361561:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302326.361576:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121537024:0@lo:400:kworker.0 00000100:00100000:0.0:1789302326.361614:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302326.361662:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121536000 00000100:00100000:0.0:1789302326.361668:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121536000 00000100:00100000:0.0:1789302326.361706:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121536512 00000100:00100000:0.0:1789302326.361710:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121536512 00000100:00100000:0.0:1789302326.361739:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121537024 00000100:00100000:2.0:1789302326.361740:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121537280:12345-0@lo:400:kworker.0 Request processed in 1931us (2666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302326.361744:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121537024 00000100:00100000:2.0:1789302326.361753:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789302326.361788:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789302326.361796:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121536000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.361908:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121536000:12345-0@lo:400:kworker.0 Request processed in 113us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302326.361915:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789302326.361943:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1789302326.363056:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121536512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302326.363074:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789302326.363085:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121537024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302326.363145:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121537024:12345-0@lo:400:kworker.0 Request processed in 61us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302326.363153:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789302326.363178:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121536512:12345-0@lo:400:kworker.0 Request processed in 1227us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302326.363186:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1789302326.363208:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121536768:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.363229:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121536000:0@lo:400:kworker.0 00000100:00100000:0.0:1789302326.363230:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121537280:0@lo:400:kworker.0 00010000:00080000:2.0:1789302326.363251:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383455c00 x1876219121536512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302326.363264:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121536512:0@lo:400:kworker.0 00010000:00080000:2.0:1789302326.363276:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383455f80 x1876219121537024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302326.363283:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121537024:0@lo:400:kworker.0 00000100:00100000:1.0:1789302326.368310:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121536640:0@lo:400:kworker.0 00000100:00100000:1.0:1789302326.368370:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302326.369129:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121536128 00000100:00100000:3.0:1789302326.369140:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121536128 00000100:00100000:2.0:1789302326.369172:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789302326.369214:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121536640 00000100:00100000:1.0:1789302326.369220:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121536640 00000100:00100000:1.0:1789302326.369260:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789302326.369266:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121536640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302326.369323:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121536640:12345-0@lo:400:kworker.0 Request processed in 57us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302326.369330:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789302326.369373:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121536640:0@lo:400:kworker.0 00000100:00100000:1.0:1789302326.369382:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121537152:0@lo:400:kworker.0 00000100:00100000:1.0:1789302326.371421:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302326.371479:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121537152 00000100:00100000:1.0:1789302326.371487:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121537152 00000100:00100000:1.0:1789302326.371535:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789302326.371544:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121537152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302326.371591:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121537152:12345-0@lo:400:kworker.0 Request processed in 48us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302326.371597:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789302326.371640:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121537152:0@lo:400:kworker.0 00000100:00080000:1.0:1789302326.371707:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302326.371711:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302326.371714:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789302326.371895:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121535744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302326.371935:0:7870:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789302326.371990:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121535744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2810us (15529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302326.372057:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121535744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302326.378376:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789302326.378403:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121536128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302326.378576:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121536128:12345-0@lo:400:kworker.0 Request processed in 187us (18465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302326.378585:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789302326.379010:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121536128:0@lo:400:kworker.0 00000100:00100000:2.0:1789302326.381407:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00010000:3.0:1789302326.677945:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302326.868741:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302326.868765:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121537408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302326.868832:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302326.868902:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121537408 00000100:00100000:0.0:1789302326.868910:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121537408 00000100:00100000:0.0:1789302326.868968:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789302326.868977:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121537408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302326.869005:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302326.869049:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121537408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302326.869056:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789302326.869098:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121537408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302326.869380:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302326.870147:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121537536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302326.870185:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302326.870814:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121537536 00000100:00100000:2.0:1789302326.870826:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121537536 00000100:00100000:2.0:1789302326.870871:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789302326.870879:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121537536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789302326.870895:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789302326.870953:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121537536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302326.870959:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789302326.871080:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121537536:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1789302326.881992:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000001:00080000:2.0:1789302326.882007:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1789302326.882018:0:6509:0:(genops.c:885:class_export_put()) final put ffff8cc3839b8000/c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:1.0:1789302326.888677:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc3839b8000/c76ee310-c3b4-4286-aaea-77936c269d98 for lustre-MDT0000 00000020:00000080:1.0:1789302326.888769:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc3839be000 for lustre-MDT0000 00000100:00100000:1.0:1789302326.966215:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302326.966300:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302326.966381:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101563264 00000100:00100000:2.0:1789302326.966401:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101563264 00000100:00100000:2.0:1789302326.966460:0:10408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101563392 00000100:00100000:2.0:1789302326.966464:0:10408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101563392 00000100:00100000:2.0:1789302326.966493:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:2.0:1789302326.966503:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60e561d9-781c-4e5b-be29-fcae8ab02e31+11:2396:x1876219101563264:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302326.966517:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302326.966535:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166fe00/0x1ff82925bd3993c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a595c expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302326.966552:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302326.966605:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60e561d9-781c-4e5b-be29-fcae8ab02e31+10:2396:x1876219101563264:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 103us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302326.966613:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:2.0:1789302326.966630:0:10408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:2.0:1789302326.966637:0:10408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60e561d9-781c-4e5b-be29-fcae8ab02e31+9:2399:x1876219101563392:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302326.966646:0:10408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302326.966666:0:10408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166f800/0x1ff82925bd3993cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a598d expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302326.966676:0:10408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302326.966694:0:10408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:2399:x1876219101563392:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 59us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302326.966700:0:10408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:3.0:1789302326.969088:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302326.969216:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101563520 00000100:00100000:1.0:1789302326.969225:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101563520 00000100:00100000:1.0:1789302326.969279:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:1.0:1789302326.969288:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60e561d9-781c-4e5b-be29-fcae8ab02e31+8:2398:x1876219101563520:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302326.969302:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302326.969319:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538f000/0x1ff82925bd399585 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5a19 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302326.969334:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302326.969379:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60e561d9-781c-4e5b-be29-fcae8ab02e31+7:2398:x1876219101563520:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302326.969455:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:3.0:1789302326.977177:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302326.977309:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101563776 00000100:00100000:0.0:1789302326.977320:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101563776 00000100:00080000:1.0:1789302326.977502:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302326.977603:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 259 00000100:00100000:0.0:1789302326.977616:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+6:2395:x1876219101563776:12345-192.168.203.9@tcp:39:umount.0 00000020:00000080:0.0:1789302326.977658:0:6530:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3993e1 00000020:00010000:0.0:1789302326.977665:0:6530:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cc381f36000: total 0 00000100:00080000:0.0:1789302326.977670:0:6530:0:(import.c:65:import_set_state_nolock()) ffff8cc381f32000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789302326.977696:0:6530:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:0.0:1789302326.977858:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fadf847f-5c0c-4967-b509-d18868692ac4+5:2395:x1876219101563776:12345-192.168.203.9@tcp:39:umount.0 Request processed in 245us (689us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1789302326.977866:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 259 00000020:00010000:1.0:1789302326.978233:0:8461:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cc381f36000: total 0 00010000:00010000:1.0:1789302326.978237:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302326.978284:0:8461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cc381f36000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789302326.978319:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc490721200) 00010000:00010000:1.0:1789302326.978322:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302326.978330:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39a38c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ded expref: 4 pid: 9541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302326.978352:0:8461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cc381f36000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789302326.978363:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302326.978365:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302326.978367:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302326.991842:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302326.992373:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101563904 00000100:00100000:2.0:1789302326.992753:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101563904 00000100:00100000:2.0:1789302326.992943:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 260 00000100:00100000:2.0:1789302326.992954:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fadf847f-5c0c-4967-b509-d18868692ac4+5:2395:x1876219101563904:12345-192.168.203.9@tcp:39:umount.0 00000020:00000080:2.0:1789302326.992995:0:6531:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3993da 00000100:00080000:2.0:1789302326.993005:0:6531:0:(import.c:65:import_set_state_nolock()) ffff8cc381f37000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789302326.993033:0:6531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789302326.993213:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fadf847f-5c0c-4967-b509-d18868692ac4+3:2395:x1876219101563904:12345-192.168.203.9@tcp:39:umount.0 Request processed in 261us (1379us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789302326.993221:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 260 00010000:00010000:0.0:1789302326.993272:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789302326.993395:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302327.036898:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302327.037046:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101564160 00000100:00100000:0.0:1789302327.037055:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101564160 00000100:00100000:0.0:1789302327.037153:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 404 00000100:00100000:0.0:1789302327.037163:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+7:2395:x1876219101564160:12345-192.168.203.9@tcp:251:umount.0 00000020:00000080:0.0:1789302327.037268:0:6524:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd39929f 00000020:00010000:0.0:1789302327.037275:0:6524:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cc383a9e000: total 0 00000100:00080000:0.0:1789302327.037279:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8cc383a9b000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789302327.037334:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:60e561d9-781c-4e5b-be29-fcae8ab02e31+3:2395:x1876219101564160:12345-192.168.203.9@tcp:251:umount.0 Request processed in 173us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302327.037340:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 404 00000020:00010000:3.0:1789302327.038385:0:6519:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cc383a9e000: total 0 00010000:00010000:3.0:1789302327.039011:0:6519:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cc383a9e000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789302327.039049:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5348a00/0x1ff82925bd399378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a594e expref: 2 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302327.039085:0:6519:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cc383a9e000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789302327.039994:0:6519:0:(genops.c:885:class_export_put()) final put ffff8cc383a9e000/60e561d9-781c-4e5b-be29-fcae8ab02e31 00010000:00010000:3.0:1789302327.040016:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302327.040018:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302327.040020:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789302327.041238:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc383a9e000/60e561d9-781c-4e5b-be29-fcae8ab02e31 for MGS 00000020:00000080:0.0:1789302327.041343:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc383a9b000 for MGS 00000100:00100000:2.0:1789302327.381084:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121537664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302327.381166:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302327.381234:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121537664 00000100:00100000:3.0:1789302327.381243:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121537664 00000100:00100000:3.0:1789302327.381294:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789302327.381303:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121537664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789302327.381336:0:6535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789302327.381415:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121537664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302327.381424:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789302327.381554:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121537664:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789302327.700736:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789302328.564831:0:15121:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789302328.576466:0:15121:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789302328.577449:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.577464:0:15121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.577473:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.577479:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.577517:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789302328.577524:0:15121:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789302328.577637:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789302328.577642:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789302328.577648:0:15121:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789302328.577678:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8cc4b513f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789302328.577719:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876219121537792:0@lo:39:umount.0 00000100:00100000:3.0:1789302328.577790:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302328.578212:0:9541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121537792 00010000:00010000:1.0:1789302328.578237:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302328.578245:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.578254:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2e00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302328.578259:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.578267:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302328.578275:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302328.578281:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302328.578284:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789302328.578286:0:6518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789302328.578324:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.578331:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302328.578358:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.578366:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2e00/0x1ff82925bd399347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd39934e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.578379:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302328.578381:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121537920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302328.578382:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302328.578385:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302328.578421:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302328.578490:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121537920 00000100:00100000:1.0:1789302328.578495:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121537920 00000100:00100000:1.0:1789302328.578546:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789302328.578650:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:483e1a3c-0199-48dd-94ee-f480825c6196+24:3645:x1876219121537920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302328.578667:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302328.578683:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166e200/0x1ff82925bd39934e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd399347 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.578695:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302328.578775:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:483e1a3c-0199-48dd-94ee-f480825c6196+23:3645:x1876219121537920:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302328.578782:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789302328.578836:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121537920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302328.578888:0:9541:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121537792 00000100:00100000:2.0:1789302328.578943:0:9541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789302328.578952:0:9541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876219121537792:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789302328.578974:0:9541:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398eb6 00000100:00080000:2.0:1789302328.578982:0:9541:0:(import.c:65:import_set_state_nolock()) ffff8cc4b513b800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789302328.579031:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302328.579045:0:9541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1876219121537792:12345-0@lo:39:umount.0 Request processed in 95us (1256us total) trans 0 rc 0/0 00000100:00080000:3.0:1789302328.579076:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b513f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789302328.579140:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876219121537792:0@lo:39:umount.0 00000100:00080000:1.0:1789302328.579223:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789302328.579227:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789302328.579231:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1789302328.579445:0:9541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1789302328.579453:0:9541:0:(genops.c:885:class_export_put()) final put ffff8cc4b513b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789302328.579639:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b513b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789302328.579699:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b513b800 for lustre-MDT0000 00010000:00010000:1.0:1789302328.580535:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.580633:0:15121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.580643:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.580651:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.580705:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302328.580713:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.580720:0:15121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.580727:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.580733:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.580798:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302328.580804:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.580811:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538e000 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302328.580814:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.580822:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302328.580829:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302328.580835:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789302328.580838:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789302328.580864:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.580887:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302328.580925:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.580932:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e000/0x1ff82925bd399355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd39935c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.580943:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302328.580947:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.580952:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982400 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302328.580955:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.580962:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302328.580968:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302328.580973:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789302328.580975:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1789302328.580988:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.580993:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302328.581011:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.581030:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302328.581032:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302328.581034:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302328.581051:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121538048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302328.581105:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302328.581177:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121538176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302328.581203:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302328.581250:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121538048 00000100:00100000:3.0:1789302328.581256:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121538048 00000100:00100000:3.0:1789302328.581293:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121538176 00000100:00100000:3.0:1789302328.581297:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121538176 00000100:00100000:3.0:1789302328.581325:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789302328.581335:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+24:3646:x1876219121538048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302328.581348:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302328.581361:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166ee00/0x1ff82925bd39935c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd399355 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.581374:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302328.581408:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+23:3646:x1876219121538048:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302328.581416:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789302328.581435:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789302328.581441:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+22:3647:x1876219121538176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302328.581449:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302328.581457:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd399260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd399259 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.581477:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302328.581505:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:483e1a3c-0199-48dd-94ee-f480825c6196+21:3647:x1876219121538176:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302328.581511:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789302328.581680:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121538176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302328.581714:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121538048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302328.583179:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789302328.583192:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd399259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd399260 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302328.583209:0:15121:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789302328.583224:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302328.583237:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.583255:0:15121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.583262:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.583269:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.583284:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302328.583293:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302328.583299:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.583307:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538fc00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302328.583311:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.583319:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302328.583327:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302328.583333:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789302328.583335:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789302328.583337:0:6519:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789302328.583368:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.583385:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302328.583413:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.583420:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538fc00/0x1ff82925bd3995bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd3995c4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.583431:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302328.583433:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302328.583434:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302328.585174:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983000/0x1ff82925bd398e15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302328.585191:0:15121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983000/0x1ff82925bd398e15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302328.585198:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983000/0x1ff82925bd398e15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302328.585206:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983000/0x1ff82925bd398e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302328.585307:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789302328.585313:0:15121:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789302328.585317:0:15121:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789302328.585353:0:15121:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789302328.585358:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789302328.585362:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789302328.585367:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:0.0:1789302328.585374:0:15121:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cc38380a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789302328.585380:0:15121:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cc381fca000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789302328.585385:0:15121:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cc4b5eac000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789302328.585389:0:15121:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cc4b5d42800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1789302328.585397:0:15121:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8cc381f36000 fadf847f-5c0c-4967-b509-d18868692ac4 192.168.203.9@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789302328.585401:0:15121:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8cc4ac2a8000) has exports, disconnecting them 00000020:00080000:0.0:1789302328.585406:0:15121:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cc38380a800), last request at 1789302326 00000020:00000080:0.0:1789302328.585412:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3991c6 00000100:00080000:0.0:1789302328.585431:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8cc38380c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789302328.585491:0:15121:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc38380a800): rc 0 00000020:00000080:0.0:1789302328.585493:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc38380a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789302328.585504:0:15121:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cc381fca000), last request at 1789302326 00000020:00000080:0.0:1789302328.585508:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3990a0 00000100:00080000:0.0:1789302328.585513:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8cc381fc8000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789302328.585521:0:15121:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc381fca000): rc 0 00000020:00000080:0.0:1789302328.585523:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc381fca000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1789302328.585526:0:15121:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cc4b5eac000), last request at 1789302081 00000020:00000080:0.0:1789302328.585528:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398f9d 00000100:00080000:0.0:1789302328.585532:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5eaf800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789302328.585536:0:15121:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc4b5eac000): rc 0 00000020:00000080:0.0:1789302328.585538:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc4b5eac000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1789302328.585542:0:15121:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cc4b5d42800), last request at 1789302081 00000020:00000080:0.0:1789302328.585545:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398f65 00000100:00080000:0.0:1789302328.585547:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5d44000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789302328.585553:0:15121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:0.0:1789302328.585618:0:15121:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc4b5d42800): rc 0 00000004:00000080:0.0:1789302328.585623:0:15121:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadc447a8fae0 00000100:00080000:0.0:1789302328.585640:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789302328.585644:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1789302328.585721:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302328.585741:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121538304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302328.585812:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302328.586165:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302328.586173:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983000/0x1ff82925bd398e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.586183:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983000 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302328.586187:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983000/0x1ff82925bd398e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.586196:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983000/0x1ff82925bd398e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302328.586203:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983000/0x1ff82925bd398e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302328.586209:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302328.586212:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789302328.586214:0:6518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789302328.586243:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983000/0x1ff82925bd398e15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.586262:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302328.586283:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983000/0x1ff82925bd398e15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.586290:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983000/0x1ff82925bd398e15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd398e1c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302328.586304:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302328.586306:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302328.586308:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302328.586314:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789302328.586544:0:15121:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789302328.586559:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5d47800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789302328.586698:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121538560:0@lo:39:umount.0 00000100:00100000:1.0:1789302328.586742:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302328.587755:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121538304 00000100:00100000:3.0:1789302328.587764:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121538304 00000100:00100000:3.0:1789302328.587826:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789302328.587836:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:483e1a3c-0199-48dd-94ee-f480825c6196+21:3647:x1876219121538304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302328.587849:0:13201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302328.587865:0:13201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4addd3400/0x1ff82925bd3995c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd3995bd expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.587908:0:13201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302328.587965:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:483e1a3c-0199-48dd-94ee-f480825c6196+20:3647:x1876219121538304:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302328.587973:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789302328.587995:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121538304:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789302328.588071:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc38380a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789302328.588146:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc381fca000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789302328.588175:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b5eac000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789302328.588195:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc38380c000 for lustre-MDT0000 00000020:00000080:3.0:1789302328.588211:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc381fc8000 for lustre-MDT0000 00000020:00000080:3.0:1789302328.588214:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b5eaf800 for lustre-MDT0000 00000100:00100000:3.0:1789302328.588232:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121538432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302328.588263:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302328.588308:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121538432 00000100:00100000:3.0:1789302328.588313:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121538432 00000100:00100000:3.0:1789302328.588346:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789302328.588352:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+20:3645:x1876219121538432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302328.588361:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302328.588370:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc480030c00/0x1ff82925bd398e1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd398e15 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302328.588380:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302328.588411:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:483e1a3c-0199-48dd-94ee-f480825c6196+19:3645:x1876219121538432:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302328.588417:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789302328.588443:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121538432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302328.588478:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789302328.589298:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789302328.589304:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000100:00100000:0.0:1789302328.589394:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121538560 00000100:00100000:0.0:1789302328.589401:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121538560 00000100:00100000:0.0:1789302328.589443:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789302328.589451:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876219121538560:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789302328.589479:0:7870:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398ff8 00000100:00080000:0.0:1789302328.589489:0:7870:0:(import.c:65:import_set_state_nolock()) ffff8cc4add88800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789302328.589521:0:7870:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000004:00080000:3.0:1789302328.589691:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789302328.589750:0:15121:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789302328.589767:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e9f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789302328.589790:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789302328.589792:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1789302328.589802:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789302328.589858:0:15121:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789302328.589867:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8cc383a9d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789302328.589931:0:15121:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cc4ac2a8000) has no exports 00000100:00100000:0.0:1789302328.590189:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3644:x1876219121538560:12345-0@lo:39:umount.0 Request processed in 738us (3447us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789302328.590198:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00010000:00010000:0.0:1789302328.590276:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302328.590372:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121538688:0@lo:9:umount.0 00000100:00100000:2.0:1789302328.590413:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302328.590441:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121538816:0@lo:9:umount.0 00000100:00100000:2.0:1789302328.590465:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789302328.590502:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5d47800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789302328.590509:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121538560:0@lo:39:umount.0 00000100:00100000:2.0:1789302328.590537:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121538688 00000100:00100000:2.0:1789302328.590542:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121538688 00000100:00100000:2.0:1789302328.590580:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121538816 00000100:00100000:2.0:1789302328.590584:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121538816 00000100:00100000:2.0:1789302328.590606:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789302328.590615:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1876219121538688:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789302328.590633:0:14588:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd399156 00000100:00080000:2.0:1789302328.590640:0:14588:0:(import.c:65:import_set_state_nolock()) ffff8cc381fcf800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789302328.590672:0:14588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789302328.590771:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3644:x1876219121538688:12345-0@lo:9:umount.0 Request processed in 158us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302328.590778:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789302328.590794:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789302328.590799:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e9f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789302328.590804:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1876219121538816:12345-0@lo:9:umount.0 00000004:00080000:3.0:1789302328.590816:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789302328.590819:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789302328.590822:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121538688:0@lo:9:umount.0 00000020:00000080:2.0:1789302328.590886:0:14588:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd39928a 00000100:00080000:2.0:1789302328.590893:0:14588:0:(import.c:65:import_set_state_nolock()) ffff8cc38380a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789302328.590936:0:14588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:3.0:1789302328.591005:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302328.591017:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3644:x1876219121538816:12345-0@lo:9:umount.0 Request processed in 216us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302328.591024:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789302328.591048:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302328.591051:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc383a9d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789302328.591052:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789302328.591067:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789302328.591071:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789302328.591075:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789302328.591079:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121538816:0@lo:9:umount.0 00000020:00080000:0.0:1789302328.595353:0:15121:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cc4ac2a8000) has no exports 00000020:00000080:0.0:1789302328.668221:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398e70 00000020:00000080:0.0:1789302328.668240:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc4b511c800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789302328.668259:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789302328.668334:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b511c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789302328.668400:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302328.668417:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789302328.668421:0:15121:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8cc4b50b8000) has no exports 00000020:00000080:1.0:1789302328.668870:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398e69 00000020:00000080:1.0:1789302328.668877:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc485d32800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789302328.668954:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302328.668962:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789302328.668972:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc485d34800/lustre-QMT0000_UUID 00000020:00000080:1.0:1789302328.668974:0:15121:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485d34800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789302328.668983:0:15121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789302328.669358:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485d32800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789302328.725797:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302329.748859:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302329.941092:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121538944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302329.941188:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302329.941433:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121538944 00000100:00100000:1.0:1789302329.941442:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121538944 00000100:00100000:1.0:1789302329.941535:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789302329.941546:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121538944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789302329.941580:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789302329.941630:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121538944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302329.941636:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789302329.941678:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121538944:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789302329.941828:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789302330.779355:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789302330.967451:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789302330.967466:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1789302330.967472:0:7462:0:(genops.c:885:class_export_put()) final put ffff8cc4b53a7800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789302330.968089:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789302330.968095:0:8439:0:(genops.c:885:class_export_put()) final put ffff8cc381fcc000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789302330.968141:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:2.0:1789302330.968144:0:8439:0:(genops.c:885:class_export_put()) final put ffff8cc38422f800/c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:3.0:1789302330.968201:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc381fcc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789302330.968252:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc38422f800/c76ee310-c3b4-4286-aaea-77936c269d98 for lustre-OST0000 00000020:00000080:3.0:1789302330.968270:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc381fcf800 for lustre-OST0000 00000020:00000080:3.0:1789302330.968275:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc38422e800 for lustre-OST0000 00000001:00100000:0.0:1789302330.968696:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fadf847f-5c0c-4967-b509-d18868692ac4 00000001:00080000:0.0:1789302330.968704:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1789302330.968707:0:7462:0:(genops.c:885:class_export_put()) final put ffff8cc381f35000/fadf847f-5c0c-4967-b509-d18868692ac4 00000020:00000080:2.0:1789302330.970179:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b53a7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1789302330.970237:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4add88800 for lustre-MDT0001 00000001:00100000:0.0:1789302330.970558:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000001:00080000:0.0:1789302330.970565:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1789302330.970569:0:7462:0:(genops.c:885:class_export_put()) final put ffff8cc3839bc800/c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:2.0:1789302330.970592:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc381f35000/fadf847f-5c0c-4967-b509-d18868692ac4 for lustre-MDT0001 00000020:00000080:2.0:1789302330.970629:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc381f37000 for lustre-MDT0001 00000020:00000080:3.0:1789302330.970708:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc3839bc800/c76ee310-c3b4-4286-aaea-77936c269d98 for lustre-MDT0001 00000020:00000080:3.0:1789302330.970750:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b7ef5800 for lustre-MDT0001 00000001:00100000:1.0:1789302330.971081:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789302330.971085:0:9525:0:(genops.c:885:class_export_put()) final put ffff8cc383808000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789302330.971106:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:1.0:1789302330.971109:0:9525:0:(genops.c:885:class_export_put()) final put ffff8cc486747800/c76ee310-c3b4-4286-aaea-77936c269d98 00000020:00000080:2.0:1789302330.971180:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc383808000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789302330.971258:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc486747800/c76ee310-c3b4-4286-aaea-77936c269d98 for lustre-OST0001 00000020:00000080:2.0:1789302330.971279:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc38380a000 for lustre-OST0001 00000020:00000080:2.0:1789302330.971283:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc38401d800 for lustre-OST0001 00000040:00080000:2.0:1789302331.286776:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789302331.476938:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121539072:0@lo:400:kworker.0 00000100:00100000:3.0:1789302331.477010:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302331.477067:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121539584:0@lo:400:kworker.0 00000100:00100000:3.0:1789302331.477094:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302331.477148:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121540096:0@lo:400:kworker.0 00000100:00100000:3.0:1789302331.477172:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302331.477210:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789302331.477217:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121539200:0@lo:400:kworker.0 00000100:00100000:3.0:1789302331.477241:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302331.477261:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121539712:0@lo:400:kworker.0 00000100:00100000:3.0:1789302331.477281:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302331.477332:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121539200 00000100:00100000:3.0:1789302331.477341:0:6535:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121539200 00000100:00100000:3.0:1789302331.477377:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789302331.477384:0:6535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1876219121539200:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789302331.477392:0:6535:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789302331.477430:0:6535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1876219121539200:12345-0@lo:400:kworker.0 Request processed in 45us (187us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789302331.477437:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:3.0:1789302331.477475:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789302331.477480:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8cc4b50b1000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789302331.477484:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789302331.478478:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121539584 00000100:00100000:0.0:1789302331.478486:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121539584 00000100:00100000:0.0:1789302331.478550:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1789302331.478560:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121539584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302331.478620:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121539584:12345-0@lo:400:kworker.0 Request processed in 63us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302331.478626:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789302331.478804:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121539072 00000100:00100000:2.0:1789302331.478810:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121539072 00000100:00100000:2.0:1789302331.478850:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789302331.478857:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+19:3647:x1876219121539072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302331.478920:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4912dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:483e1a3c-0199-48dd-94ee-f480825c6196+19:3647:x1876219121539072:12345-0@lo:400:kworker.0 Request processed in 64us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302331.478926:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789302331.478956:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121540096 00000100:00100000:2.0:1789302331.478960:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121540096 00000100:00100000:2.0:1789302331.478985:0:14588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121539712 00000100:00100000:2.0:1789302331.478988:0:14588:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121539712 00000100:00100000:2.0:1789302331.479005:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789302331.479011:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121540096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302331.479041:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121540096:12345-0@lo:400:kworker.0 Request processed in 30us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302331.479046:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789302331.479056:0:14588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789302331.479061:0:14588:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121539712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302331.479085:0:14588:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121539712:12345-0@lo:400:kworker.0 Request processed in 24us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302331.479090:0:14588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:2.0:1789302331.479330:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302331.479334:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302331.479336:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789302331.479742:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121539328:0@lo:400:kworker.0 00000100:00100000:1.0:1789302331.479786:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302331.479822:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121539840:0@lo:400:kworker.0 00000100:00100000:1.0:1789302331.479844:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302331.479868:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789302331.479874:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121539456:0@lo:400:kworker.0 00000100:00100000:1.0:1789302331.479906:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302331.479926:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121539968:0@lo:400:kworker.0 00000100:00100000:1.0:1789302331.479945:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302331.479975:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121539328 00000100:00100000:1.0:1789302331.479980:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121539328 00000100:00100000:1.0:1789302331.480005:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121539840 00000100:00100000:1.0:1789302331.480008:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121539840 00000100:00100000:1.0:1789302331.480015:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121539456 00000100:00100000:1.0:1789302331.480017:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121539456 00000100:00100000:1.0:1789302331.480039:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121539968 00000100:00100000:1.0:1789302331.480041:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121539968 00000100:00100000:1.0:1789302331.480067:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789302331.480073:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121539968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302331.480146:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121539968:12345-0@lo:400:kworker.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302331.480153:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789302331.480167:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789302331.480172:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876219121539328:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789302331.480177:0:10111:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789302331.480393:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876219121539328:12345-0@lo:400:kworker.0 Request processed in 219us (605us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789302331.480400:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789302331.480414:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789302331.480418:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876219121539840:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789302331.480422:0:10111:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789302331.480443:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876219121539840:12345-0@lo:400:kworker.0 Request processed in 24us (598us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789302331.480449:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789302331.480459:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789302331.480463:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876219121539456:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789302331.480467:0:10111:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789302331.480488:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876219121539456:12345-0@lo:400:kworker.0 Request processed in 23us (581us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789302331.480494:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1789302331.481165:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789302331.481405:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789302331.481426:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8cc382630800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789302331.481431:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789302331.481436:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8cc382630800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302331.481440:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 178 00000100:00080000:1.0:1789302331.481451:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cc382630800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302331.481483:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc383805500 x1876219121540224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302331.481709:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876219121540224:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789302331.481758:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302331.481816:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121539456:0@lo:400:kworker.0 00010000:00080000:1.0:1789302331.481835:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384052a00 x1876219121539968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302331.481846:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121539968:0@lo:400:kworker.0 00000100:00080000:1.0:1789302331.481858:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789302331.481861:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5ec9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789302331.481864:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789302331.481867:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5ec9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302331.481870:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 157 00000100:00080000:1.0:1789302331.481875:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cc4b5ec9800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302331.481903:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc498ad7480 x1876219121540352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789302331.481966:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121540224 00000100:00100000:2.0:1789302331.481974:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121540224 00000100:00100000:2.0:1789302331.482010:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789302331.482018:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876219121540224:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1789302331.482033:0:6531:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789302331.483469:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876219121540352:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789302331.483535:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302331.483597:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121540352 00000100:00100000:0.0:1789302331.483604:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121540352 00000100:00100000:0.0:1789302331.483637:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789302331.483643:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121540352:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789302331.483659:0:6532:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789302331.483701:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121540352:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 57us (167us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789302331.483708:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1789302331.483744:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5ec9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302331.483750:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789302331.483753:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876219121540352:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789302331.483913:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121539328:0@lo:400:kworker.0 00000100:00080000:1.0:1789302331.483933:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789302331.483937:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8cc38367d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789302331.483955:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789302331.483960:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8cc38367d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302331.483964:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 203 00000100:00080000:1.0:1789302331.483973:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cc38367d000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302331.484000:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc498ad7480 x1876219121540480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302331.484016:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876219121539840:0@lo:400:kworker.0 00000100:00100000:0.0:1789302331.484351:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876219121540480:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789302331.484385:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302331.484602:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121540480 00000100:00100000:1.0:1789302331.484608:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121540480 00000100:00100000:1.0:1789302331.484643:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789302331.484649:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121540480:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1789302331.484663:0:6532:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789302331.484702:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121540480:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 52us (315us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789302331.484709:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1789302331.484740:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc38367d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789302331.484744:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789302331.484748:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876219121540480:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1789302331.496379:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8cc4b50b1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302331.496397:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 157 00000100:00080000:3.0:1789302331.496414:0:3647:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cc4b50b1000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302331.496455:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd800380 x1876219121540608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302331.496526:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121540608:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789302331.496600:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302331.496957:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121539200:0@lo:400:kworker.0 00000100:00100000:3.0:1789302331.496990:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121539712:0@lo:400:kworker.0 00000100:00100000:3.0:1789302331.497002:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:483e1a3c-0199-48dd-94ee-f480825c6196:3647:1876219121539072:0@lo:400:kworker.0 00010000:00080000:3.0:1789302331.497015:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384050e00 x1876219121539584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302331.497025:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121539584:0@lo:400:kworker.0 00000100:00100000:3.0:1789302331.497036:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121540096:0@lo:400:kworker.0 00000100:00100000:0.0:1789302331.498063:0:7870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121540608 00000100:00100000:0.0:1789302331.498072:0:7870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121540608 00000100:00100000:0.0:1789302331.498138:0:7870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789302331.498146:0:7870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876219121540608:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1789302331.498164:0:7870:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789302331.498458:0:7870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876219121540608:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 311us (1857us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789302331.498466:0:7870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:1.0:1789302331.498526:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b50b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789302331.498532:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789302331.498536:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121540608:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789302331.508862:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876219121540224:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 26834us (27094us total) trans 0 rc -19/-19 00000100:00080000:1.0:1789302331.509247:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc382630800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789302331.509264:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789302331.509269:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876219121540224:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789302331.509419:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00010000:0.0:1789302331.798405:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302331.988541:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302331.988564:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121540736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302331.988629:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302331.988803:0:12212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121540736 00000100:00100000:1.0:1789302331.988812:0:12212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121540736 00000100:00100000:1.0:1789302331.988865:0:12212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789302331.988890:0:12212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121540736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302331.988917:0:12212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789302331.988972:0:12212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121540736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302331.988980:0:12212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789302331.989155:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121540736:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789302332.821699:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789302333.025562:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789302333.025572:0:6509:0:(genops.c:885:class_export_put()) final put ffff8cc4b5d42800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789302333.025604:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fadf847f-5c0c-4967-b509-d18868692ac4 00000001:00080000:2.0:1789302333.025610:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:2.0:1789302333.025614:0:6509:0:(genops.c:885:class_export_put()) final put ffff8cc381f36000/fadf847f-5c0c-4967-b509-d18868692ac4 00000020:00000080:0.0:1789302333.025820:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b5d42800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1789302333.025939:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc381f36000/fadf847f-5c0c-4967-b509-d18868692ac4 for lustre-MDT0000 00000020:00000080:0.0:1789302333.025986:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b5d44000 for lustre-MDT0000 00000020:00000080:0.0:1789302333.026005:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc381f32000 for lustre-MDT0000 00010000:00010000:2.0:1789302333.844514:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789302334.740230:0:15121:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cc382854360 - data ffff8cc4a977a510/ffff8cc4bd8ed800 00000020:01000000:1.0:1789302334.740537:0:15121:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cc487c6f960 - data ffff8cc4a9568288/ffff8cc4b50ddc00 00000001:00000004:3.0:1789302334.756374:0:15121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1789302334.836999:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789302334.837007:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789302334.837021:0:15121:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8cc485d50380 x1876219121538560/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789302338 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302334.837284:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789302334.841925:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789302334.841933:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1789302334.841955:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789302334.841957:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789302334.843355:0:8847:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789302334.843362:0:8847:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1789302334.843375:0:8847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789302334.845769:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789302334.846413:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1789302334.846490:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789302334.846493:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789302334.850086:0:10018:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789302334.850095:0:10018:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1789302334.850129:0:10018:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789302334.852472:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398e38 00000020:00000080:3.0:1789302334.852486:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc485de4000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789302334.856964:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398e4d 00000020:00000080:3.0:1789302334.856978:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc485de7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789302334.858078:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485de4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789302334.859528:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789302334.859550:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789302334.859559:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789302334.859564:0:15121:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8cc4ac2acd40) has no exports 00000004:01000000:3.0:1789302334.859734:0:15121:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789302334.859743:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd399283 00000020:00000080:3.0:1789302334.859751:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc383a9c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789302334.859968:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485de7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789302334.860036:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789302334.860041:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789302334.860051:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:0.0:1789302334.860492:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc383a9c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00080000:3.0:1789302334.860602:0:15121:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff8cc381fc19c0) has no exports 00000020:00000080:3.0:1789302334.860612:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd39927c 00000020:00000080:3.0:1789302334.860619:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc383a98000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789302334.860701:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc383a98000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789302334.861536:0:15121:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789302334.861676:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789302334.861681:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1789302334.861688:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789302334.861690:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789302334.861787:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789302334.861831:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789302334.861840:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd399141 00000020:00000080:3.0:1789302334.861847:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc4b50b7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789302334.861978:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc383a9d000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789302334.861986:0:37:0:(genops.c:885:class_export_put()) final put ffff8cc383a98800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789302334.861989:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc383a98800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789302334.861995:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789302334.862560:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789302334.862567:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789302334.862576:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789302334.862580:0:15121:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8cc4bd97b380) has no exports 00000020:00000080:3.0:1789302334.862587:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd39913a 00000020:00000080:3.0:1789302334.862591:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc4b7e9d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789302334.862660:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b50b7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1789302334.863248:0:15121:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789302334.863252:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789302334.863255:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1789302334.863368:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789302334.863370:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789302334.863623:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b7e9d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789302334.863713:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789302334.863724:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789302334.863740:0:15121:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789302334.863746:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398ff1 00000020:00000080:3.0:1789302334.863753:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc4add8d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789302334.863834:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b7e9f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789302334.863841:0:37:0:(genops.c:885:class_export_put()) final put ffff8cc4b53a0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789302334.863843:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b53a0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789302334.863849:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789302334.863951:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789302334.863956:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789302334.863962:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789302334.863966:0:15121:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8cc4b87719c0) has no exports 00000020:00000080:3.0:1789302334.863970:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398fea 00000020:00000080:3.0:1789302334.863974:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc4b5d46800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789302334.864328:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4add8d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789302334.864335:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b5d46800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789302334.866397:0:15121:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1789302334.866405:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789302334.866408:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1789302334.866416:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789302334.866458:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302334.866469:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789302334.866495:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302334.866517:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789302334.866521:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc4880df000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789302334.866525:0:15121:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4880df000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789302334.866533:0:15121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789302334.866638:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398e54 00000020:00000080:2.0:1789302334.866645:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc485de5800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789302334.866649:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789302334.866652:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302334.866656:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789302334.866660:0:15121:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8cc485df3380) has no exports 00000020:00000080:2.0:1789302334.866684:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302334.866687:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789302334.866691:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398e5b 00000020:00000080:2.0:1789302334.866694:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc485de3800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789302334.866702:0:15121:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc4b863d000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789302334.866704:0:15121:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc4b863d000 3 00000020:01000004:2.0:1789302334.866707:0:15121:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cc4b863d000 from lustre-MDT0000 00000020:00000080:2.0:1789302334.866723:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789302334.866763:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b5d47800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789302334.866769:0:37:0:(genops.c:885:class_export_put()) final put ffff8cc4b5ecb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789302334.866894:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789302334.866898:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc485de2800/lustre-MDT0000_UUID 00000020:00000080:2.0:1789302334.866900:0:15121:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485de2800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789302334.866907:0:15121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789302334.866937:0:15121:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1789302334.866941:0:15121:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789302334.866944:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789302334.866947:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302334.866951:0:15121:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789302334.866956:0:15121:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8cc4ac2a0000 483e1a3c-0199-48dd-94ee-f480825c6196 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789302334.866962:0:15121:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8cc4aa9399c0) has exports, disconnecting them 00000020:00080000:2.0:1789302334.866966:0:15121:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cc4ac2a0000), last request at 1789302062 00000020:00000080:2.0:1789302334.866982:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398df9 00000020:00010000:2.0:1789302334.866986:0:15121:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cc4ac2a0000: total 2 00000100:00080000:2.0:1789302334.867000:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8cc4ac2a5000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789302334.867014:0:15121:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc4ac2a0000): rc 0 00000020:00080000:2.0:1789302334.867018:0:15121:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8cc4aa9399c0) has no exports 00000100:00100000:2.0:1789302334.867077:0:6525:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cc485300000:6525] 2 exiting: rc = 0 00000100:00100000:2.0:1789302334.867211:0:6523:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cc4a93dee00:6523] 0 exiting: rc = 1 00000020:00000080:0.0:1789302334.867499:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b5ecb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789302334.867506:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789302334.867569:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485de5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789302334.867574:0:37:0:(genops.c:885:class_export_put()) final put ffff8cc485de6800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789302334.867576:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485de6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789302334.867585:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789302334.867610:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485de3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1789302334.867621:0:6518:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cc4ac2a0000: total 0 00010000:00010000:0.0:1789302334.867638:0:6518:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cc4ac2a0000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789302334.867666:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5349600/0x1ff82925bd399324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd39931d expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867681:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538e200/0x1ff82925bd399332 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd39932b expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867692:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166e600/0x1ff82925bd398ef5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd398eee expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867704:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc480031600/0x1ff82925bd398f03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd398efc expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867717:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5349a00/0x1ff82925bd399340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd399339 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867726:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd3992fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd3992f3 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867735:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538ee00/0x1ff82925bd3995a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd3995a1 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867744:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4addd2000/0x1ff82925bd3995b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd3995af expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867753:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4c2179a00/0x1ff82925bd39959a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd399593 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867901:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166fa00/0x1ff82925bd39936a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd399363 expref: 5 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867914:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4addd3000/0x1ff82925bd399308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd399301 expref: 4 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867923:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b538f800/0x1ff82925bd39921a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd399213 expref: 3 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867934:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5348400/0x1ff82925bd399316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1ff82925bd39930f expref: 2 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302334.867944:0:6518:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cc4ac2a0000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789302334.867958:0:6518:0:(genops.c:885:class_export_put()) final put ffff8cc4ac2a0000/483e1a3c-0199-48dd-94ee-f480825c6196 00010000:00010000:0.0:1789302334.867979:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302334.867982:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302334.867984:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302334.868013:0:6524:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cc483f29e00:6524] 1 exiting: rc = 0 00000020:00000080:2.0:1789302334.868091:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4ac2a0000/483e1a3c-0199-48dd-94ee-f480825c6196 for MGS 00000020:00000080:2.0:1789302334.868141:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4ac2a5000 for MGS 00000100:00100000:2.0:1789302334.868172:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868190:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868195:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868201:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868207:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868213:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868220:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868225:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868230:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868236:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868241:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868247:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868252:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868527:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868538:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868600:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868606:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868611:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868616:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868623:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868628:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868633:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868638:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868643:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868651:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868656:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868661:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868677:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868683:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868689:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868694:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868699:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868704:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868710:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868715:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868720:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868725:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868731:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868735:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868740:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868746:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868750:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868755:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868759:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868765:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868770:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868843:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868849:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868854:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868869:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868875:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868880:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868885:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868891:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868896:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868901:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868906:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868911:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868918:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868925:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868932:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868938:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868954:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302334.868958:0:15121:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1789302334.870879:0:15121:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cc4b52964e0 - data ffff8cc4a977f510/ffff8cc482b70800 00000020:01000000:2.0:1789302334.871008:0:15121:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cc4a6ee60c0 - data ffff8cc4a942f798/ffff8cc4a92bb400 00000020:00000080:2.0:1789302334.871972:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398ddd 00000020:00000080:2.0:1789302334.871981:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc482f37800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789302334.871994:0:15121:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc4b863d000 from MGS, refs=2 00000020:01000004:2.0:1789302334.871997:0:15121:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc4b863d000 2 00000020:01000004:2.0:1789302334.872001:0:15121:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cc4b863d000 from MGS 00000020:00000080:2.0:1789302334.872020:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302334.872027:0:15121:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789302334.872030:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc49a6b0000/MGS 00000020:00000080:2.0:1789302334.872033:0:15121:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc49a6b0000/MGS for MGS 00000020:01000000:2.0:1789302334.872039:0:15121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789302334.872095:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789302334.872099:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302334.872326:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789302334.872333:0:15121:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cc4b513d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789302334.872339:0:15121:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8cc485df19c0) has exports, disconnecting them 00000020:00080000:2.0:1789302334.872344:0:15121:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cc4b513d000), last request at 1789302062 00000020:00000080:2.0:1789302334.872348:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398ea8 00000020:00080000:2.0:1789302334.873655:0:15121:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc4b513d000): rc 0 00000020:00000080:2.0:1789302334.873662:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc4b513d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789302334.874623:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc482f37800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789302334.874640:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b513d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789302334.976367:0:15121:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789302334.976376:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789302334.976380:0:15121:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789302334.976387:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789302334.976416:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b513f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789302334.976790:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789302334.976800:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789302334.976806:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc4b50b1800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789302334.976821:0:15121:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b50b1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789302334.976830:0:15121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789302334.976917:0:15121:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc4b863d000 1 00000020:00000080:0.0:1789302334.976924:0:15121:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398dcf 00000020:00000080:0.0:1789302334.976931:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc484fbe000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789302334.976942:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789302334.976951:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc484fbe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789302334.976961:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789302334.976966:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789302334.976970:0:15121:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8cc4b8774d40) has no exports 00000100:00100000:0.0:1789302335.064289:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121540864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302335.064358:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302335.064434:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121540864 00000100:00100000:0.0:1789302335.064442:0:8449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121540864 00000100:00100000:0.0:1789302335.064497:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789302335.064506:0:8449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121540864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302335.064530:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789302335.064581:0:8449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121540864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302335.064588:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1789302335.064609:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302335.064642:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121540864:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789302335.085900:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789302335.099967:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789302335.100187:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789302335.100269:0:15121:0:(genops.c:885:class_export_put()) final put ffff8cc4b863c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789302335.100275:0:15121:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b863c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789302335.100286:0:15121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789302335.100398:0:15121:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cc4b863c000 00000020:02000400:0.0:1789302335.100470:0:15121:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789302336.148278:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789302336.603076:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302336.603082:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789302336.603086:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc4b50b1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302336.603094:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 407 00000100:00080000:3.0:1789302336.603099:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789302336.603174:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cc4b50b1000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302336.603197:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd801f80 x1876219121541120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302336.603213:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302336.603217:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789302336.603218:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5ec9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302336.603222:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 407 00000100:00080000:3.0:1789302336.603224:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789302336.603229:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cc4b5ec9800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302336.603239:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd801c00 x1876219121541248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302336.603248:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302336.603252:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789302336.603254:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc382630800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302336.603257:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 407 00000100:00080000:3.0:1789302336.603259:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789302336.603263:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cc382630800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302336.603272:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd803100 x1876219121541376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302336.603302:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302336.603305:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789302336.603307:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc38367d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302336.603311:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 407 00000100:00080000:3.0:1789302336.603313:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789302336.603323:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cc38367d000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302336.603334:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd801880 x1876219121541760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789302336.603370:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121541504:0@lo:400:kworker.0 00000100:00100000:3.0:1789302336.603432:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302336.603484:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302336.603490:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121541632:0@lo:400:kworker.0 00000100:00100000:3.0:1789302336.603516:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302336.603636:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121541888:0@lo:400:kworker.0 00000100:00100000:3.0:1789302336.603698:0:10111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121541504 00000100:00100000:3.0:1789302336.603706:0:10111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121541504 00000100:00100000:3.0:1789302336.603761:0:10111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789302336.603770:0:10111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121541504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302336.603855:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121540992:0@lo:400:kworker.0 00000100:00100000:1.0:1789302336.603899:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302336.603929:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121541120:0@lo:38:kworker.0 00000100:00100000:1.0:1789302336.603953:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302336.603970:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876219121541248:0@lo:38:kworker.0 00000100:00100000:1.0:1789302336.603987:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302336.604006:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876219121541376:0@lo:38:kworker.0 00000100:00100000:1.0:1789302336.604024:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302336.604043:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876219121541760:0@lo:38:kworker.0 00000100:00100000:1.0:1789302336.604062:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302336.604086:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121541888 00000100:00100000:1.0:1789302336.604090:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121541888 00000100:00100000:1.0:1789302336.604128:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121541248 00000100:00100000:1.0:1789302336.604139:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121541248 00000100:00100000:1.0:1789302336.604151:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121541376 00000100:00100000:1.0:1789302336.604153:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121541376 00000100:00100000:1.0:1789302336.604160:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121541760 00000100:00100000:1.0:1789302336.604162:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121541760 00000100:00100000:1.0:1789302336.604170:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789302336.604177:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121541888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302336.604214:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121541888:12345-0@lo:400:kworker.0 Request processed in 37us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302336.604221:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789302336.604238:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789302336.604243:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121541248:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789302336.604261:0:6532:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789302336.604291:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121541248:12345-0@lo:38:kworker.0 Request processed in 46us (302us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789302336.604297:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789302336.604308:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789302336.604312:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121541376:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789302336.604321:0:6532:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789302336.604344:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121541376:12345-0@lo:38:kworker.0 Request processed in 30us (319us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789302336.604350:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789302336.604360:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789302336.604364:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121541760:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789302336.604373:0:6532:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789302336.604393:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121541760:12345-0@lo:38:kworker.0 Request processed in 28us (330us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789302336.604407:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789302336.604425:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121541120 00000100:00100000:1.0:1789302336.604429:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121541120 00000100:00100000:1.0:1789302336.604446:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789302336.604450:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876219121541120:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789302336.604460:0:6536:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789302336.605800:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876219121541120:12345-0@lo:38:kworker.0 Request processed in 1342us (1839us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789302336.605812:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:1.0:1789302336.605898:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8cc4bd801180 x1876219121541888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302336.605912:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121541888:0@lo:400:kworker.0 00000100:00080000:1.0:1789302336.605945:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b50b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789302336.605950:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789302336.605953:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121541120:0@lo:38:kworker.0 00000100:00080000:1.0:1789302336.605962:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5ec9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789302336.605966:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789302336.605969:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876219121541248:0@lo:38:kworker.0 00000100:00080000:1.0:1789302336.605977:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc382630800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789302336.605980:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789302336.605984:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876219121541376:0@lo:38:kworker.0 00000100:00080000:1.0:1789302336.605992:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc38367d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789302336.605996:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789302336.606007:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876219121541760:0@lo:38:kworker.0 00000100:00100000:3.0:1789302336.607587:0:10111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121541504:12345-0@lo:400:kworker.0 Request processed in 3810us (4147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302336.607601:0:10111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789302336.607643:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121541632 00000100:00100000:3.0:1789302336.607651:0:8447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121541632 00000100:00100000:3.0:1789302336.607692:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789302336.607701:0:8447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121541632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302336.607752:0:8447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121541632:12345-0@lo:400:kworker.0 Request processed in 51us (4235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302336.607758:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1789302336.607775:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302336.607820:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121541632:0@lo:400:kworker.0 00010000:00080000:3.0:1789302336.607835:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8cc4bd802d80 x1876219121541504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302336.607872:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121541504:0@lo:400:kworker.0 00000400:00000100:0.0:1789302336.611872:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876219121540992 offset 0 length 224: 4 00000100:00100000:0.0:1789302336.611926:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121542016:0@lo:400:kworker.0 00000100:00100000:0.0:1789302336.611974:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302336.612019:0:8852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121542016 00000100:00100000:0.0:1789302336.612025:0:8852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121542016 00000100:00100000:0.0:1789302336.612079:0:8852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789302336.612088:0:8852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121542016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302336.612170:0:8852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121542016:12345-0@lo:400:kworker.0 Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302336.612176:0:8852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:0.0:1789302336.612196:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302336.612228:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121542016:0@lo:400:kworker.0 00000100:00100000:2.0:1789302337.117513:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302337.117536:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121542144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302337.117598:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302337.117747:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121542144 00000100:00100000:0.0:1789302337.117756:0:8448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121542144 00000100:00100000:0.0:1789302337.117810:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789302337.117820:0:8448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121542144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302337.117857:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789302337.117902:0:8448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121542144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302337.117908:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789302337.118079:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121542144:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789302337.175057:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302338.196326:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789302338.790341:0:15323:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789302338.819050:0:15323:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1789302338.819102:0:15323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.819143:0:15323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.819162:0:15323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.819169:0:15323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.819191:0:15323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789302338.819196:0:15323:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789302338.819221:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789302338.819225:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789302338.819229:0:15323:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789302338.819235:0:15323:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5ec9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789302338.819240:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789302338.819241:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789302338.819243:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789302338.820083:0:15323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.820097:0:15323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.820103:0:15323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.820110:0:15323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.820209:0:15323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789302338.820225:0:15323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.820233:0:15323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.820238:0:15323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.820245:0:15323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820339:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789302338.820347:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820354:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2600 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302338.820357:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820365:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302338.820372:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302338.820377:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302338.820380:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789302338.820382:0:6518:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789302338.820415:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820421:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789302338.820469:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121542272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302338.820534:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302338.820606:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820614:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2600/0x1ff82925bd39932b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd399332 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820628:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302338.820631:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820646:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd3200 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302338.820650:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820656:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302338.820662:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302338.820667:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302338.820669:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1789302338.820683:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820688:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302338.820704:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820710:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4addd3200/0x1ff82925bd399339 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd399340 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820719:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302338.820722:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820727:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2179c00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302338.820730:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820746:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302338.820752:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302338.820757:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302338.820759:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1789302338.820771:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820777:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302338.820783:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302338.820791:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302338.820793:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302338.820795:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302338.820810:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121542400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302338.820853:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302338.820875:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302338.820881:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121542528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302338.820904:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302338.820941:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121542272 00000100:00100000:1.0:1789302338.820948:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121542272 00000100:00100000:1.0:1789302338.820980:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121542400 00000100:00100000:1.0:1789302338.820984:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121542400 00000100:00100000:1.0:1789302338.820999:0:13201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121542528 00000100:00100000:1.0:1789302338.821002:0:13201:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121542528 00000100:00100000:1.0:1789302338.821024:0:13201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789302338.821030:0:13201:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1876219121542272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789302338.821036:0:13201:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789302338 with bad export cookie 2303636451465203193 00000100:00100000:3.0:1789302338.822401:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302338.822411:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a6ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1876219121542400:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789302338.822418:0:6516:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789302338 with bad export cookie 2303636451465203193 00000100:00100000:3.0:1789302338.822491:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a6ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1876219121542400:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1636us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789302338.822497:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302338.822519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789302338.822523:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1876219121542528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789302338.822528:0:6516:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789302338 with bad export cookie 2303636451465203193 00000100:00100000:3.0:1789302338.822553:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1876219121542528:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (1649us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789302338.822559:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1789302338.823592:0:15323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302338.823604:0:15323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4c2179c00/0x1ff82925bd399213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd39921a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302338.823629:0:15323:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789302338.823641:0:15323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.823650:0:15323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.823656:0:15323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.823664:0:15323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.823683:0:15323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302338.823688:0:15323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166f600/0x1ff82925bd398efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.823707:0:15323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166f600/0x1ff82925bd398efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.823713:0:15323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166f600/0x1ff82925bd398efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.823719:0:15323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc48166f600/0x1ff82925bd398efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302338.823727:0:15323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789302338.823730:0:15323:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1789302338.823733:0:15323:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1789302338.823768:0:15323:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1789302338.823772:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1789302338.823776:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789302338.823781:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789302338.823787:0:15323:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8cc382b0e000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789302338.823793:0:15323:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8cc4b52a7000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789302338.823798:0:15323:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8cc4aa938000) has exports, disconnecting them 00000020:00080000:0.0:1789302338.823802:0:15323:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8cc382b0e000), last request at 1789302336 00000020:00000080:0.0:1789302338.823808:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3991db 00000100:00080000:0.0:1789302338.823823:0:15323:0:(import.c:65:import_set_state_nolock()) ffff8cc382b0c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789302338.823948:0:15323:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc382b0e000): rc 0 00000020:00000080:0.0:1789302338.823950:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc382b0e000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1789302338.823968:0:15323:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8cc4b52a7000), last request at 1789302336 00000020:00000080:0.0:1789302338.823972:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3990b5 00000100:00080000:0.0:1789302338.823977:0:15323:0:(import.c:65:import_set_state_nolock()) ffff8cc4b52a4000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789302338.823984:0:15323:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc4b52a7000): rc 0 00000020:00000080:0.0:1789302338.823992:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc4b52a7000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1789302338.823999:0:15323:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffadc441c87ae0 00000100:00080000:0.0:1789302338.824017:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789302338.824020:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1789302338.824793:0:15323:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789302338.824800:0:15323:0:(import.c:65:import_set_state_nolock()) ffff8cc4b50b1000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789302338.824935:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789302338.824938:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1789302338.824950:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789302338.825018:0:15323:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789302338.825039:0:15323:0:(import.c:65:import_set_state_nolock()) ffff8cc4b50b5800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789302338.825061:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789302338.825063:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1789302338.825071:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789302338.825159:0:15323:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789302338.825168:0:15323:0:(import.c:65:import_set_state_nolock()) ffff8cc3839ba800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789302338.825188:0:15323:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8cc4aa938000) has no exports 00010000:00010000:3.0:1789302338.825266:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302338.825275:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302338.825284:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538e800 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302338.825288:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302338.825298:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302338.825315:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302338.825321:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789302338.825323:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789302338.825326:0:8461:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789302338.825351:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302338.825358:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302338.825385:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302338.825393:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e800/0x1ff82925bd3995af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd3995b6 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302338.825404:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302338.825408:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48166f600/0x1ff82925bd398efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302338.825414:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166f600 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302338.825417:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166f600/0x1ff82925bd398efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302338.825424:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48166f600/0x1ff82925bd398efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302338.825430:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166f600/0x1ff82925bd398efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302338.825446:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789302338.825449:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789302338.825451:0:8461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789302338.825464:0:8461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc48166f600/0x1ff82925bd398efc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302338.825470:0:8461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302338.825476:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48166f600/0x1ff82925bd398efc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302338.825483:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48166f600/0x1ff82925bd398efc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1ff82925bd398f03 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302338.825496:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302338.825498:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302338.825500:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302338.825518:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121543040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302338.825578:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302338.825618:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302338.825624:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121542912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302338.825645:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302338.825668:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121543040 00000100:00100000:3.0:1789302338.825673:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121543040 00000100:00100000:3.0:1789302338.825697:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121542912 00000100:00100000:3.0:1789302338.825700:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121542912 00000100:00100000:3.0:1789302338.825713:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789302338.825719:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1876219121543040:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789302338.825725:0:6516:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789302338 with bad export cookie 2303636451465203193 00000100:00100000:3.0:1789302338.825773:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1876219121543040:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (196us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789302338.825781:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789302338.825795:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302338.825799:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1876219121542912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789302338.825802:0:6516:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789302338 with bad export cookie 2303636451465203193 00000100:00100000:3.0:1789302338.825825:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1876219121542912:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (179us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789302338.825845:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789302338.825872:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789302338.825876:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8cc487de1000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789302338.825879:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.109@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1789302338.826906:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789302338.826923:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc382b0e000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1789302338.826980:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b52a7000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1789302338.827004:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc382b0c800 for lustre-MDT0001 00000020:00000080:2.0:1789302338.827009:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b52a4000 for lustre-MDT0001 00000100:00080000:0.0:1789302338.828229:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.109@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1789302338.830075:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121542656:0@lo:9:umount.0 00000100:00100000:1.0:1789302338.830170:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302338.830203:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121542784:0@lo:9:umount.0 00000100:00100000:1.0:1789302338.830226:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302338.830352:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121542656 00000100:00100000:1.0:1789302338.830360:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121542656 00000100:00100000:1.0:1789302338.830411:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121542784 00000100:00100000:1.0:1789302338.830415:0:8445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121542784 00000100:00100000:1.0:1789302338.830439:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789302338.830448:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876219121542656:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789302338.830473:0:8445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd399102 00000100:00080000:1.0:1789302338.830482:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cc382631000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789302338.830521:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789302338.830660:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3644:x1876219121542656:12345-0@lo:9:umount.0 Request processed in 212us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302338.830667:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789302338.830683:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789302338.830689:0:8445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876219121542784:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789302338.830701:0:8445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd399244 00000100:00080000:1.0:1789302338.830706:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cc382b0a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789302338.830727:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789302338.830796:0:8445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3644:x1876219121542784:12345-0@lo:9:umount.0 Request processed in 107us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302338.830802:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789302338.849793:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302338.849803:0:6526:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789302338.850109:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302338.850254:0:13201:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1876219121542272:12345-0@lo:103:ldlm_bl.0 Request processed in 29218us (29715us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789302338.850265:0:13201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789302338.851315:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b50b5800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789302338.851336:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789302338.851338:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789302338.851343:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121542656:0@lo:9:umount.0 00000100:00080000:1.0:1789302338.851359:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc3839ba800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789302338.851369:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789302338.851370:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789302338.851373:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121542784:0@lo:9:umount.0 00010000:00010000:1.0:1789302338.851406:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302338.851412:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789302338.857131:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.109@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789302338.857135:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789302338.857145:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc4bd802680 x1876219121540992/t0(0) o400->MGC192.168.203.109@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789302352 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302338.857169:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc484fe3800 x1876219121542272/t0(0) o103->MGC192.168.203.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789302354 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302338.857178:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc484fe0380 x1876219121542400/t0(0) o103->MGC192.168.203.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789302354 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302338.857187:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc3843ed500 x1876219121542528/t0(0) o103->MGC192.168.203.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789302354 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302338.857195:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc4bd800700 x1876219121543040/t0(0) o103->MGC192.168.203.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789302354 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302338.857203:0:3648:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc4bd803800 x1876219121542912/t0(0) o103->MGC192.168.203.109@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789302354 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789302338.857257:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8cc487de1000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789302338.857284:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121542400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302338.857312:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:483e1a3c-0199-48dd-94ee-f480825c6196:3645:1876219121542528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302338.857364:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:483e1a3c-0199-48dd-94ee-f480825c6196:3646:1876219121540992:0@lo:400:kworker.0 10000000:01000000:3.0:1789302338.862797:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789302338.862821:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789302338.862840:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789302338.862845:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8cc487de1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302338.862853:0:3648:0:(import.c:545:import_select_connection()) MGC192.168.203.109@tcp: connect to NID 0@lo last attempt 138 00000100:00080000:3.0:1789302338.862868:0:3648:0:(import.c:666:import_select_connection()) MGC192.168.203.109@tcp: import ffff8cc487de1000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302338.862902:0:3648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd803100 x1876219121543168/t0(0) o250->MGC192.168.203.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302338.862957:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:483e1a3c-0199-48dd-94ee-f480825c6196:3644:1876219121543168:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1789302338.863016:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876219121543168 offset 0 length 520: 4 00000100:00100000:3.0:1789302338.863285:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121543040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302338.863294:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121542272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302338.863318:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:483e1a3c-0199-48dd-94ee-f480825c6196:3648:1876219121542912:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789302338.880644:0:15323:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8cc4aa938000) has no exports 00000020:01000000:1.0:1789302338.949001:0:15323:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cc3828543c0 - data ffff8cc4a977a000/ffff8cc4bd8ee400 00000020:01000000:1.0:1789302338.949700:0:15323:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cc4adde3720 - data ffff8cc4a9665798/ffff8cc4ade02400 00000001:00000004:1.0:1789302338.964318:0:15323:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789302339.012043:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789302339.012052:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789302339.012059:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789302339.016216:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789302339.016223:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789302339.016239:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789302339.016241:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789302339.016500:0:8842:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789302339.016506:0:8842:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789302339.016516:0:8842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789302339.021897:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789302339.021905:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789302339.021964:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789302339.021967:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789302339.022752:0:10013:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789302339.022757:0:10013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789302339.022767:0:10013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789302339.023653:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398f1f 00000020:00000080:2.0:1789302339.023663:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc485d32000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789302339.024196:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485d32000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789302339.030813:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398f34 00000020:00000080:2.0:1789302339.030826:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc4880db000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789302339.030851:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789302339.030856:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302339.030864:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789302339.030868:0:15323:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8cc4aa93cd40) has no exports 00000004:01000000:2.0:1789302339.031030:0:15323:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789302339.031041:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd39923d 00000020:00000080:2.0:1789302339.031046:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc383a99800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789302339.031049:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789302339.031053:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302339.031060:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789302339.031062:0:15323:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff8cc381fc3380) has no exports 00000020:00000080:2.0:1789302339.031068:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd399236 00000020:00000080:2.0:1789302339.031071:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc3839b9000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789302339.031180:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4880db000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1789302339.031194:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc383a99800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789302339.031198:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc3839b9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789302339.031508:0:15323:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789302339.031513:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789302339.031517:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1789302339.031522:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789302339.031524:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789302339.031601:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302339.031609:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789302339.031615:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3990fb 00000020:00000080:2.0:1789302339.031619:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc382634000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789302339.033410:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc3839ba800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789302339.033427:0:13920:0:(genops.c:885:class_export_put()) final put ffff8cc3839bd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789302339.033430:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc3839bd800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789302339.033439:0:13920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789302339.039901:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789302339.039940:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302339.039952:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789302339.039957:0:15323:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8cc4b50bb380) has no exports 00000020:00000080:2.0:1789302339.039965:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3990f4 00000020:00000080:2.0:1789302339.039974:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc4b50b6800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789302339.045460:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc382634000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:2.0:1789302339.046504:0:15323:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789302339.046510:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789302339.046514:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1789302339.046520:0:15323:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789302339.046523:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789302339.053586:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b50b6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789302339.054094:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302339.054109:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789302339.054147:0:15323:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789302339.054170:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398f57 00000020:00000080:2.0:1789302339.054180:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc4b5eab000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789302339.060357:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b50b5800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789302339.060376:0:13920:0:(genops.c:885:class_export_put()) final put ffff8cc4b52a3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789302339.060379:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b52a3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789302339.060386:0:13920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789302339.060620:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789302339.060628:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302339.060638:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789302339.060642:0:15323:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8cc485df4d40) has no exports 00000020:00000080:2.0:1789302339.060649:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398f50 00000020:00000080:2.0:1789302339.060656:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc4b50b4000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789302339.070808:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b5eab000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789302339.070826:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b50b4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789302339.096217:0:15323:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789302339.096226:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789302339.096232:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789302339.096241:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789302339.096309:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789302339.096322:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789302339.096362:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789302339.096366:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789302339.096371:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc485d48800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789302339.096376:0:15323:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485d48800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789302339.096387:0:15323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789302339.096545:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398f3b 00000020:00000080:0.0:1789302339.096551:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc4880de800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789302339.096556:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789302339.096559:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789302339.096564:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789302339.096567:0:15323:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8cc4aa93b380) has no exports 00000020:00000080:0.0:1789302339.096586:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789302339.096589:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789302339.096593:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398f42 00000020:00000080:0.0:1789302339.096596:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc4880dd800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789302339.096603:0:15323:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc4b511e800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789302339.096615:0:15323:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc4b511e800 2 00000020:01000004:0.0:1789302339.096618:0:15323:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cc4b511e800 from lustre-MDT0001 00000020:00000080:0.0:1789302339.096643:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789302339.096647:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789302339.096650:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc485d36000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789302339.096652:0:15323:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485d36000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789302339.096658:0:15323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789302339.096684:0:15323:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789302339.096688:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789302339.096691:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789302339.096694:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789302339.096700:0:15323:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8cc4b5ecf000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789302339.096705:0:15323:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8cc4b8773380) has exports, disconnecting them 00000020:00080000:0.0:1789302339.096709:0:15323:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8cc4b5ecf000), last request at 1789302081 00000020:00000080:0.0:1789302339.096712:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398f96 00000020:00080000:0.0:1789302339.096723:0:15323:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc4b5ecf000): rc 0 00000020:00000080:0.0:1789302339.096726:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc4b5ecf000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789302339.097415:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b50b1000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789302339.097422:0:13920:0:(genops.c:885:class_export_put()) final put ffff8cc4b50b3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789302339.097432:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b50b3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789302339.097440:0:13920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789302339.097545:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4880de800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789302339.097549:0:13920:0:(genops.c:885:class_export_put()) final put ffff8cc485d4c800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789302339.097551:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc485d4c800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789302339.097554:0:13920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789302339.097733:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4880dd800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789302339.097739:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b5ecf000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789302339.098161:0:15323:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789302339.098166:0:15323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789302339.098178:0:15323:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789302339.098187:0:15323:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789302339.098319:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302339.098324:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789302339.098328:0:15323:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc4b511e800 1 00000020:00000080:1.0:1789302339.098333:0:15323:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398ed2 00000020:00000080:1.0:1789302339.098337:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc4b53a3000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789302339.098340:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789302339.098344:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302339.098347:0:15323:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789302339.098350:0:15323:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8cc4b8770000) has no exports 00000020:00000080:1.0:1789302339.099857:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc4b5ec9800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789302339.099869:0:13920:0:(genops.c:885:class_export_put()) final put ffff8cc4b5d43800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789302339.099872:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b5d43800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789302339.099879:0:13920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789302339.099952:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b53a3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789302339.167005:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302339.167019:0:15323:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789302339.167024:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc4b511b000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789302339.167028:0:15323:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4b511b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789302339.167039:0:15323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1789302339.168204:0:15323:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cc4b511a800 00000020:01000000:3.0:1789302339.168237:0:15323:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789302339.168251:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789302339.168260:0:15323:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789302339.168265:0:15323:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8cc4ac2a99c0) has no exports 00000100:00100000:3.0:1789302339.168352:0:10111:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8cc38397f400:10111] 4 exiting: rc = 0 00000100:00100000:3.0:1789302339.168450:0:9541:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8cc483f29200:9541] 3 exiting: rc = 0 00000100:00100000:1.0:1789302339.169735:0:6532:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8cc490eb9c00:6532] 2 exiting: rc = 0 00000100:00100000:1.0:1789302339.169825:0:6530:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8cc48309a800:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1789302339.169919:0:6531:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8cc490eb8400:6531] 1 exiting: rc = 0 00000100:00100000:1.0:1789302339.169984:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.169992:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.169997:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170002:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170009:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170014:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170020:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170026:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170033:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170037:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170042:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170048:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170053:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170059:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170065:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170071:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170076:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170082:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170088:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170093:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170098:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170103:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170108:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170131:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170137:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170142:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170148:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170153:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170159:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170164:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170169:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170175:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170180:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170186:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170191:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170202:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170208:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170213:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170218:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170223:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170229:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170234:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170239:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170244:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170250:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170255:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170260:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170265:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170271:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170276:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170280:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170286:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170291:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170296:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170300:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170306:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170311:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170316:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170321:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170327:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170332:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170337:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170342:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.170347:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302339.180201:0:6533:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cc4b9298400:6533] 0 exiting: rc = 1 00000100:00100000:0.0:1789302339.180463:0:6534:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cc4b9298200:6534] 1 exiting: rc = 0 00000100:00100000:1.0:1789302339.180610:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180620:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180632:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180640:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180648:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180654:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180677:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180683:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180689:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180699:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180706:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180712:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180729:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180736:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180741:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180746:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180751:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180757:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180762:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180767:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180773:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180778:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180783:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180788:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180793:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180799:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180804:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180810:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180815:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180821:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180826:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180839:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180845:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180850:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180856:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180861:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180867:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180872:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180877:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180882:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180888:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180900:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180905:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180910:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180914:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180919:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180925:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180930:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180935:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180940:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180946:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180951:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180957:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180961:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180966:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180971:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180976:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180980:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180985:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180990:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.180996:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.181000:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.181005:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.181010:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302339.181656:0:6536:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8cc484c02200:6536] 1 exiting: rc = 0 00000100:00100000:3.0:1789302339.181796:0:6535:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8cc48a9dfe00:6535] 0 exiting: rc = 1 00000100:00100000:0.0:1789302339.181958:0:7870:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8cc4adc04e00:7870] 2 exiting: rc = 0 00000100:00100000:1.0:1789302339.182082:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182103:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182455:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182463:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182469:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182476:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182482:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182488:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182494:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182499:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182504:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182577:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182606:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182613:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182619:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182625:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182631:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182637:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182643:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182649:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182654:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182660:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182666:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182672:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182694:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182701:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182707:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182713:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182785:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182792:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182798:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182803:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182809:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182814:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182821:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182837:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182858:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182865:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182871:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182877:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182884:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182890:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182897:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182903:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182910:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182916:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182921:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182934:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182953:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182959:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182965:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182970:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182976:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182982:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182988:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.182993:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.183000:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.183007:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.183013:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.183018:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.183040:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.183049:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.183054:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302339.183061:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302339.202492:0:6537:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cc490782800:6537] 0 exiting: rc = 1 00000100:00100000:3.0:1789302339.202783:0:6538:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cc4aa981600:6538] 1 exiting: rc = 0 00000100:00100000:0.0:1789302339.202907:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202914:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202919:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202925:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202931:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202936:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202941:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202946:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202952:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202957:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202961:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202966:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202982:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202987:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202992:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.202997:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203001:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203005:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203010:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203016:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203021:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203026:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203030:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203035:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203039:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203044:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203050:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203055:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203060:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203064:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203068:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203072:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203077:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203082:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203087:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203091:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203096:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203100:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203104:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.203108:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204783:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204793:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204799:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204803:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204809:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204814:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204819:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204851:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204856:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204861:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204867:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204872:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204877:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204882:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204888:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204892:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204897:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204902:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204908:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204912:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204917:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204922:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204927:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.204932:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302339.206575:0:6540:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cc48a877e00:6540] 1 exiting: rc = 0 00000100:00100000:2.0:1789302339.206790:0:6539:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cc48a877a00:6539] 0 exiting: rc = 1 00000100:00100000:0.0:1789302339.206901:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206908:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206913:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206919:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206924:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206929:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206933:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206939:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206943:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206948:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206953:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206958:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206963:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206968:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206973:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206979:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206983:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.206989:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207004:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207009:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207014:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207019:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207024:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207029:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207034:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207040:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207044:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207049:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207053:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207059:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207063:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207068:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207073:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207079:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207084:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207089:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207094:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207100:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207105:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207325:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207333:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207339:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207344:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207349:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207355:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207360:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207365:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207371:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207376:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207381:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207386:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207391:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207396:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207409:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207413:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207417:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207422:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207426:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207432:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207437:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207441:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207447:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207452:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.207457:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302339.208151:0:6541:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cc48a876200:6541] 0 exiting: rc = 1 00000100:00100000:1.0:1789302339.208367:0:6542:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cc48a877200:6542] 1 exiting: rc = 0 00000100:00100000:0.0:1789302339.208984:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.208991:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.208996:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209001:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209006:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209011:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209016:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209021:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209027:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209032:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209037:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209042:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209046:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209051:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209056:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209061:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209065:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209070:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209075:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209080:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209085:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209090:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209094:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209098:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209150:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209153:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209159:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209164:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209168:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209172:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209177:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209181:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209185:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209190:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209194:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209199:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209203:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209208:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209212:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209216:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209221:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209225:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209229:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209233:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209237:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209242:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209247:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209251:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209256:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209261:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209266:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209270:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209274:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209278:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209282:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209286:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209291:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209297:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209302:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209314:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209319:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209323:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209328:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.209333:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302339.210020:0:6543:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8cc48a877000:6543] 0 exiting: rc = 1 00000100:00100000:1.0:1789302339.210256:0:6544:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8cc4aa980c00:6544] 1 exiting: rc = 0 00000100:00100000:1.0:1789302339.210406:0:6545:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8cc485d39200:6545] 2 exiting: rc = 0 00000100:00100000:0.0:1789302339.210597:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210604:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210611:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210616:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210622:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210635:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210643:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210649:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210655:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210660:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210665:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210670:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210676:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210682:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210702:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210710:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210715:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210721:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210792:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210801:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210807:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210812:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210818:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210824:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210842:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210848:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210853:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210860:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210865:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210871:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210889:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210895:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210900:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210906:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210912:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210917:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210923:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210928:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210947:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210954:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210959:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210964:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210970:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210975:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210981:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210986:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210992:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.210997:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211003:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211010:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211016:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211022:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211028:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211033:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211039:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211045:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211051:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211057:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211063:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211068:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211074:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211081:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211088:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302339.211095:0:15323:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789302339.216420:0:15323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789302339.216432:0:15323:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789302339.216439:0:15323:0:(genops.c:885:class_export_put()) final put ffff8cc487de7800/MDS_uuid 00000020:00000080:3.0:1789302339.216443:0:15323:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc487de7800/MDS_uuid for MDS 00000020:01000000:3.0:1789302339.216448:0:15323:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789302339.216691:0:15323:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1789302339.224262:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302340.244758:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302341.268670:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789302341.716294:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 483e1a3c-0199-48dd-94ee-f480825c6196->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302341.716303:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 483e1a3c-0199-48dd-94ee-f480825c6196->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302341.716306:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302341.716309:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789302341.716314:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc382630800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302341.716322:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 412 00000100:00080000:3.0:1789302341.716328:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789302341.716342:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cc382630800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302341.716385:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd803800 x1876219121543296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302341.716446:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302341.716449:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789302341.716451:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc38367d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302341.716455:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 412 00000100:00080000:3.0:1789302341.716458:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789302341.716463:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cc38367d000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302341.716476:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd801c00 x1876219121543552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789302341.716539:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121543680:0@lo:400:kworker.0 00000400:00000100:3.0:1789302341.716588:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219121543680 offset 0 length 224: 4 00000100:00100000:3.0:1789302341.716641:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302341.716647:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121543424:0@lo:400:kworker.0 00000400:00000100:3.0:1789302341.716683:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219121543424 offset 0 length 224: 4 00000100:00100000:0.0:1789302341.717277:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876219121543296:0@lo:38:kworker.0 00000400:00000100:0.0:1789302341.717314:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219121543296 offset 0 length 520: 4 00000100:00100000:0.0:1789302341.717338:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876219121543552:0@lo:38:kworker.0 00000400:00000100:0.0:1789302341.717355:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219121543552 offset 0 length 520: 4 00010000:00010000:2.0:1789302342.292396:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789302343.148298:0:15523:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789302343.177658:0:15523:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789302343.177710:0:15523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302343.177725:0:15523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302343.177733:0:15523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302343.177740:0:15523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302343.177798:0:15523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789302343.177812:0:15523:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789302343.177835:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789302343.177846:0:15523:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc4bd803800 x1876219121543296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789302361 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302343.177864:0:15523:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789302343.177877:0:15523:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789302343.177882:0:15523:0:(import.c:65:import_set_state_nolock()) ffff8cc382630800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789302343.177886:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789302343.177890:0:15523:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc4bd803800 x1876219121543296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789302361 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302343.177897:0:15523:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789302343.177900:0:15523:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:0.0:1789302343.178044:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876219121543296:0@lo:38:kworker.0 00010000:00010000:1.0:1789302343.179513:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302343.179523:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302343.179532:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166ec00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302343.179537:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302343.179546:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302343.179573:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302343.179579:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302343.179582:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789302343.179584:0:8461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789302343.179598:0:8461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cc487de1000 00010000:00010000:1.0:1789302343.179601:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302343.179608:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48166ec00/0x1ff82925bd39930f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd399316 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302343.179620:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302343.179622:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302343.179624:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789302343.179709:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789302343.179721:0:15523:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc4bd800700 x1876219121543424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302357 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302343.179779:0:15523:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789302343.179785:0:15523:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789302343.179813:0:15523:0:(import.c:65:import_set_state_nolock()) ffff8cc381fcb000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789302343.179968:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876219121543808:0@lo:39:umount.0 00000400:00000100:0.0:1789302343.180013:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219121543808 offset 0 length 224: 4 00000100:00100000:2.0:1789302343.180096:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121543424:0@lo:400:kworker.0 00010000:00010000:1.0:1789302343.316296:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789302343.764315:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 483e1a3c-0199-48dd-94ee-f480825c6196->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789302343.764325:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 483e1a3c-0199-48dd-94ee-f480825c6196->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789302343.764328:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789302343.764331:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789302343.764526:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302343.764546:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121543936:0@lo:400:kworker.0 00000400:00000100:3.0:1789302343.764594:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219121543936 offset 0 length 224: 4 00010000:00010000:2.0:1789302344.342078:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789302344.795258:0:8439:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789302344.795267:0:8439:0:(genops.c:885:class_export_put()) final put ffff8cc382632800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789302344.795393:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc382632800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789302344.795461:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc382631000 for lustre-OST0000 00000001:00100000:1.0:1789302344.796715:0:9525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789302344.796721:0:9525:0:(genops.c:885:class_export_put()) final put ffff8cc382b08800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789302344.797065:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc382b08800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789302344.797283:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc382b0a000 for lustre-OST0001 00010000:00010000:1.0:1789302345.364334:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302346.388346:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789302346.772362:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 483e1a3c-0199-48dd-94ee-f480825c6196->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789302346.772372:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 483e1a3c-0199-48dd-94ee-f480825c6196->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789302346.772391:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789302346.772395:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789302346.772492:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121544064:0@lo:400:kworker.0 00000400:00000100:3.0:1789302346.772546:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219121544064 offset 0 length 224: 4 00010000:00010000:2.0:1789302347.413031:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302348.308282:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302338/real 1789302338] req@ffff8cc4bd803100 x1876219121543168/t0(0) o250->MGC192.168.203.109@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789302348 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302348.308313:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc4bd803100 x1876219121543168/t0(0) o250->MGC192.168.203.109@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789302348 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789302348.308334:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc487de1000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302348.308359:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789302348.308363:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:483e1a3c-0199-48dd-94ee-f480825c6196:3644:1876219121543168:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1789302348.308447:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 483e1a3c-0199-48dd-94ee-f480825c6196->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789302348.308452:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789302348.308454:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc487de1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302348.308459:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.109@tcp: connect to NID 0@lo last attempt 414 00000100:00080000:1.0:1789302348.308463:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.109@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789302348.308475:0:37:0:(import.c:666:import_select_connection()) MGC192.168.203.109@tcp: import ffff8cc487de1000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302348.308571:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc3843ed180 x1876219121544192/t0(0) o250->MGC192.168.203.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302348.308623:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:483e1a3c-0199-48dd-94ee-f480825c6196:3644:1876219121544192:0@lo:250:kworker.0 00000400:00000100:0.0:1789302348.308670:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876219121544192 offset 0 length 520: 4 00000100:00080000:1.0:1789302348.308867:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789302348.308871:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789302348.308937:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121544320:0@lo:400:kworker.0 00000400:00000100:2.0:1789302348.308962:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219121544320 offset 0 length 224: 4 00010000:00010000:1.0:1789302348.436255:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302349.460296:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302350.484343:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302351.508241:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302352.532277:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302353.428717:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302343/real 1789302343] req@ffff8cc4bd801180 x1876219121543808/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789302353 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302353.428764:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc4bd801180 x1876219121543808/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789302353 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789302353.428810:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc381fcb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789302353.428830:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876219121543808:0@lo:39:umount.0 00000100:00080000:3.0:1789302353.429131:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789302353.429136:0:15523:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789302353.429141:0:15523:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789302353.430025:0:15523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302353.430039:0:15523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302353.430046:0:15523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302353.430054:0:15523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302353.430613:0:15523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302353.430623:0:15523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302353.430645:0:15523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302353.430650:0:15523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302353.430656:0:15523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302353.430689:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302353.430697:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302353.430715:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f600 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302353.430737:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302353.430746:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302353.430753:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302353.430759:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789302353.430762:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1789302353.436634:0:6518:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cc487de1000 00010000:00010000:2.0:1789302353.436647:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302353.436658:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538f600/0x1ff82925bd39931d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd399324 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302353.436678:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302353.436683:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302353.436690:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4addd2a00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302353.436694:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302353.436703:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302353.436727:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302353.436744:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789302353.436747:0:6518:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789302353.436758:0:6518:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cc487de1000 00010000:00010000:2.0:1789302353.436761:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302353.436768:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302353.436770:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302353.436782:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302353.442970:0:15523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789302353.442988:0:15523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4addd2a00/0x1ff82925bd3995a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd3995a8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302353.443010:0:15523:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789302353.443019:0:15523:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1789302353.443022:0:15523:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789302353.443056:0:15523:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789302353.443060:0:15523:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789302353.443069:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789302353.443075:0:15523:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789302353.443079:0:15523:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8cc381fc4d40) has no exports 00000020:00080000:3.0:1789302353.443103:0:15523:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8cc381fc4d40) has no exports 00000020:01000000:3.0:1789302353.451397:0:15523:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cc382854f00 - data ffff8cc4a942f510/ffff8cc4bd8ee800 00000020:01000000:3.0:1789302353.451515:0:15523:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cc382706f00 - data ffff8cc4a9667360/ffff8cc382787c00 00010000:00010000:1.0:1789302353.453771:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789302353.464283:0:15523:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789302353.470603:0:15523:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd39906f 00000020:00000080:1.0:1789302353.470615:0:15523:0:(genops.c:885:class_export_put()) final put ffff8cc381fcc800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789302353.470976:0:15523:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc4adc31000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789302353.470980:0:15523:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc4adc31000 2 00000020:01000004:1.0:1789302353.470984:0:15523:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cc4adc31000 from lustre-OST0000 00000020:00000080:1.0:1789302353.471016:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302353.471036:0:15523:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789302353.471039:0:15523:0:(genops.c:885:class_export_put()) final put ffff8cc4880db800/lustre-OST0000_UUID 00000020:00000080:1.0:1789302353.471042:0:15523:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4880db800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789302353.471048:0:15523:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789302353.471103:0:15523:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789302353.471107:0:15523:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789302353.471129:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302353.471135:0:15523:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789302353.471140:0:15523:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cc382635800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789302353.471146:0:15523:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8cc3826299c0) has exports, disconnecting them 00000020:00080000:1.0:1789302353.471150:0:15523:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cc382635800), last request at 1789302102 00000020:00000080:1.0:1789302353.471153:0:15523:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd399099 00000020:00080000:1.0:1789302353.471163:0:15523:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc382635800): rc 0 00000020:00000080:1.0:1789302353.471167:0:15523:0:(genops.c:885:class_export_put()) final put ffff8cc382635800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789302353.474875:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc381fcc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789302353.475434:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc382635800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789302353.480690:0:15523:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789302353.480699:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789302353.480703:0:15523:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789302353.480710:0:15523:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789302353.480902:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302353.480910:0:15523:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789302353.480916:0:15523:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789302353.480920:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302353.480924:0:15523:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789302353.481086:0:15523:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8cc381fc8800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789302353.481094:0:15523:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff8cc381fc0000) has exports, disconnecting them 00000020:00080000:2.0:1789302353.481099:0:15523:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8cc381fc8800), last request at 1789302102 00000020:00000080:2.0:1789302353.481104:0:15523:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3990ae 00000020:00080000:2.0:1789302353.481156:0:15523:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc381fc8800): rc 0 00000020:00000080:2.0:1789302353.481162:0:15523:0:(genops.c:885:class_export_put()) final put ffff8cc381fc8800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789302353.481883:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc382630800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789302353.481892:0:13920:0:(genops.c:885:class_export_put()) final put ffff8cc4bdbdf800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789302353.481894:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4bdbdf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789302353.481906:0:13920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789302353.481986:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc381fc8800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789302353.484323:0:15523:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789302353.484330:0:15523:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789302353.484335:0:15523:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789302353.484342:0:15523:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789302353.484379:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc381fcb000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789302353.484546:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789302353.484554:0:15523:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789302353.484567:0:15523:0:(genops.c:885:class_export_put()) final put ffff8cc381fcd000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789302353.484571:0:15523:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc381fcd000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789302353.484577:0:15523:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789302353.484651:0:15523:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc4adc31000 1 00000020:00000080:3.0:1789302353.484656:0:15523:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd399037 00000020:00000080:3.0:1789302353.484662:0:15523:0:(genops.c:885:class_export_put()) final put ffff8cc4add8f000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789302353.484670:0:15523:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789302353.484677:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4add8f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789302353.484686:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789302353.484691:0:15523:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789302353.484695:0:15523:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8cc485df0000) has no exports 00000100:00080000:3.0:1789302353.494561:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) 483e1a3c-0199-48dd-94ee-f480825c6196->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302353.494572:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) 483e1a3c-0199-48dd-94ee-f480825c6196->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302353.494575:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302353.494578:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789302353.494649:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121544448:0@lo:400:kworker.0 00000400:00000100:3.0:1789302353.494701:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219121544448 offset 0 length 224: 4 00010000:00010000:1.0:1789302353.573920:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789302353.593507:0:15523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302353.593521:0:15523:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789302353.593527:0:15523:0:(genops.c:885:class_export_put()) final put ffff8cc4adc35000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789302353.593531:0:15523:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4adc35000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789302353.593543:0:15523:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789302353.593649:0:15523:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cc4adc30000 00000020:02000400:2.0:1789302353.593689:0:15523:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789302354.581063:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302355.605096:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302356.628373:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1789302357.589193:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302341/real 1789302341] req@ffff8cc4bd801f80 x1876219121543680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789302357 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302357.617466:0:3646:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8cc4bd801f80 x1876219121543680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789302357 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789302357.617480:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8cc38380d800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789302357.617483:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789302357.635218:0:3646:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1789302357.635332:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) 483e1a3c-0199-48dd-94ee-f480825c6196->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302357.635337:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) 483e1a3c-0199-48dd-94ee-f480825c6196->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302357.635339:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302357.635342:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302357.635344:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302357.635347:0:13920:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789302357.635351:0:13920:0:(import.c:65:import_set_state_nolock()) ffff8cc38380d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302357.635358:0:13920:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 203 00000100:00080000:3.0:1789302357.635372:0:13920:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8cc38380d800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302357.635404:0:13920:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd803100 x1876219121544576/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789302357.635444:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876219121544576:0@lo:38:kworker.0 00000400:00000100:3.0:1789302357.637831:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219121544576 offset 0 length 520: 4 00000100:00100000:2.0:1789302357.639358:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121543680:0@lo:400:kworker.0 00010000:00010000:2.0:1789302357.652237:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789302357.657781:0:15725:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789302357.675731:0:15725:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789302357.675832:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302357.676019:0:15725:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302357.676030:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302357.676037:0:15725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302357.676064:0:15725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789302357.676069:0:15725:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789302357.676104:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789302357.676133:0:15725:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc4bd801c00 x1876219121543552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789302361 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302357.676171:0:15725:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789302357.676178:0:15725:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789302357.676183:0:15725:0:(import.c:65:import_set_state_nolock()) ffff8cc38367d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789302357.676188:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789302357.676192:0:15725:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc4bd801c00 x1876219121543552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789302361 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302357.676198:0:15725:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789302357.676202:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:1.0:1789302357.676267:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302357.676274:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.676281:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349800 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302357.676285:0:8461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.676293:0:8461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302357.676300:0:8461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302357.676306:0:8461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302357.676309:0:8461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789302357.676311:0:8461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789302357.676325:0:8461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cc487de1000 00010000:00010000:1.0:1789302357.676336:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.676343:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd3992f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd3992fa expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.676353:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302357.676355:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302357.676357:0:8461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302357.676438:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876219121543552:0@lo:38:kworker.0 00000100:00080000:0.0:1789302357.680664:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789302357.680684:0:15725:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc3843ef800 x1876219121543936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302359 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302357.680973:0:15725:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc3843ee300 x1876219121544064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302362 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302357.680981:0:15725:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc3843ef100 x1876219121544320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302364 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302357.680998:0:15725:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc4bd801180 x1876219121544448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302357.681026:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121544064:0@lo:400:kworker.0 00000100:00100000:3.0:1789302357.681070:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121544320:0@lo:400:kworker.0 00000100:00100000:0.0:1789302357.681104:0:15725:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc4bd803100 x1876219121544576/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789302367 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302357.681141:0:15725:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789302357.681146:0:15725:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789302357.681186:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876219121544448:0@lo:400:kworker.0 00000100:00100000:1.0:1789302357.683665:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876219121543936:0@lo:400:kworker.0 00000100:00080000:3.0:1789302357.683717:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc38380d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789302357.683723:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1789302357.683727:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876219121544576:0@lo:38:kworker.0 00000100:00080000:0.0:1789302357.684103:0:15725:0:(import.c:65:import_set_state_nolock()) ffff8cc38380d800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789302357.684135:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789302357.684142:0:15725:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc4bd801180 x1876219121544448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302369 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302357.684152:0:15725:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789302357.684157:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789302357.685817:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302357.685834:0:15725:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302357.685913:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302357.685920:0:15725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302357.685984:0:15725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302357.685992:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302357.685999:0:15725:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302357.686005:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302357.686010:0:15725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.686064:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302357.686071:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.686078:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166e000 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302357.686081:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.686089:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302357.686097:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302357.686102:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302357.686104:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1789302357.686136:0:6519:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cc487de1000 00010000:00010000:1.0:1789302357.686141:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.686153:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48166e000/0x1ff82925bd399301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd399308 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.686166:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302357.686169:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.686174:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538e600 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302357.686176:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.686183:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302357.686190:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302357.686195:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789302357.686197:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789302357.686202:0:6519:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cc487de1000 00010000:00010000:1.0:1789302357.686204:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302357.686211:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302357.686212:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302357.686214:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302357.686321:0:15725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302357.686326:0:15725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd399593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd39959a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302357.686339:0:15725:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789302357.686350:0:15725:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789302357.686354:0:15725:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789302357.686378:0:15725:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789302357.686382:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789302357.686387:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789302357.686397:0:15725:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789302357.686401:0:15725:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8cc382628000) has no exports 00000020:00080000:0.0:1789302357.686424:0:15725:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8cc382628000) has no exports 00000020:01000000:0.0:1789302357.688502:0:15725:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cc3837deae0 - data ffff8cc4a9765bd0/ffff8cc383934c00 00000020:01000000:0.0:1789302357.688645:0:15725:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cc4b5296ba0 - data ffff8cc4a970f5e8/ffff8cc4bdbc1400 00010000:00010000:2.0:1789302357.689494:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789302357.699474:0:15725:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789302357.706539:0:15725:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd399195 00000020:00000080:3.0:1789302357.706552:0:15725:0:(genops.c:885:class_export_put()) final put ffff8cc4880d8800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789302357.706613:0:15725:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc382b0f800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789302357.706618:0:15725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc382b0f800 2 00000020:01000004:3.0:1789302357.706621:0:15725:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cc382b0f800 from lustre-OST0001 00000020:00000080:3.0:1789302357.706644:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789302357.706652:0:15725:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789302357.706655:0:15725:0:(genops.c:885:class_export_put()) final put ffff8cc382b0e800/lustre-OST0001_UUID 00000020:00000080:3.0:1789302357.706658:0:15725:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc382b0e800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789302357.706664:0:15725:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789302357.706799:0:15725:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 483e1a3c-0199-48dd-94ee-f480825c6196->MGS 00010000:00010000:3.0:1789302357.706845:0:15725:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982600/0x1ff82925bd398eee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd398ef5 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302357.706857:0:15725:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982600/0x1ff82925bd398eee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd398ef5 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302357.706864:0:15725:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789302357.706867:0:15725:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789302357.706870:0:15725:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789302357.706882:0:15725:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cc487de1000 00010000:00010000:3.0:1789302357.706886:0:15725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982600/0x1ff82925bd398eee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd398ef5 expref: -99 pid: 7460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302357.706900:0:15725:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd399363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1ff82925bd39936a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302357.706916:0:15725:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd399363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1ff82925bd39936a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302357.706922:0:15725:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789302357.706924:0:15725:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789302357.706926:0:15725:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789302357.706936:0:15725:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cc487de1000 00010000:00010000:3.0:1789302357.706939:0:15725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd399363 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1ff82925bd39936a expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789302357.706956:0:15725:0:(import.c:65:import_set_state_nolock()) ffff8cc487de1000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789302357.706960:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789302357.706962:0:15725:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789302357.706964:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789302357.706968:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789302357.707035:0:15725:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cc3843ed180 x1876219121544192/t0(0) o250->MGC192.168.203.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789302363 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789302357.707058:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789302357.707061:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1789302357.709895:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:483e1a3c-0199-48dd-94ee-f480825c6196:3644:1876219121544192:0@lo:250:kworker.0 10000000:01000000:3.0:1789302357.709969:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789302357.709990:0:15725:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd398deb 00000020:00000080:3.0:1789302357.709999:0:15725:0:(genops.c:885:class_export_put()) final put ffff8cc487de3000/483e1a3c-0199-48dd-94ee-f480825c6196 00000020:00000080:1.0:1789302357.710067:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4880d8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789302357.710301:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.109@tcp (flags='') 00000020:00000080:3.0:1789302357.710310:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789302357.710317:0:15725:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.109@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789302357.710320:0:15725:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8cc4ac2ab380) has no exports 00000020:00000080:1.0:1789302357.710404:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc487de3000/483e1a3c-0199-48dd-94ee-f480825c6196 for MGC192.168.203.109@tcp 10000000:01000000:0.0:1789302357.710604:0:6527:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789302357.710686:0:15725:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.109@tcp: client import never connected 00000100:00080000:3.0:1789302357.710691:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789302357.710693:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789302357.710696:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789302357.710720:0:15725:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789302357.710804:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789302357.710811:0:15725:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.109@tcp (uuid 483e1a3c-0199-48dd-94ee-f480825c6196) 00000020:01000000:3.0:1789302357.710817:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789302357.710820:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789302357.710824:0:15725:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789302357.710829:0:15725:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8cc38367e000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789302357.710835:0:15725:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff8cc38262b380) has exports, disconnecting them 00000020:00080000:3.0:1789302357.710839:0:15725:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8cc38367e000), last request at 1789302127 00000020:00000080:3.0:1789302357.710842:0:15725:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3991bf 00000020:00080000:3.0:1789302357.710854:0:15725:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc38367e000): rc 0 00000020:00000080:3.0:1789302357.710858:0:15725:0:(genops.c:885:class_export_put()) final put ffff8cc38367e000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789302357.710881:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc487de1000 for MGC192.168.203.109@tcp 00000020:00000080:1.0:1789302357.710892:0:13920:0:(genops.c:885:class_export_put()) final put ffff8cc487de7000/483e1a3c-0199-48dd-94ee-f480825c6196 00000020:00000080:1.0:1789302357.710894:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc487de7000/483e1a3c-0199-48dd-94ee-f480825c6196 for MGC192.168.203.109@tcp 00000020:01000000:1.0:1789302357.710899:0:13920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.109@tcp (483e1a3c-0199-48dd-94ee-f480825c6196) 00000020:00000080:1.0:1789302357.712457:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc38367e000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789302357.713245:0:15725:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789302357.713251:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789302357.713255:0:15725:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789302357.713260:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789302357.713475:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789302357.713483:0:15725:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789302357.713489:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789302357.713495:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789302357.713499:0:15725:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789302357.713506:0:15725:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8cc38380f000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789302357.713513:0:15725:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff8cc383818000) has exports, disconnecting them 00000020:00080000:0.0:1789302357.713517:0:15725:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8cc38380f000), last request at 1789302127 00000020:00000080:0.0:1789302357.713522:0:15725:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd3991d4 00000020:00080000:0.0:1789302357.713536:0:15725:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cc38380f000): rc 0 00000020:00000080:0.0:1789302357.713541:0:15725:0:(genops.c:885:class_export_put()) final put ffff8cc38380f000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789302357.714488:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc38367d000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789302357.714498:0:13920:0:(genops.c:885:class_export_put()) final put ffff8cc383679800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789302357.714501:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc383679800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789302357.714507:0:13920:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789302357.714569:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc38380f000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789302357.715179:0:15725:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789302357.715184:0:15725:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789302357.715187:0:15725:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789302357.715193:0:15725:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789302357.715214:0:13920:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cc38380d800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789302357.715256:0:8461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789302357.715357:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789302357.748188:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789302357.748366:0:6514:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cc4a9376a00:6514] 1 exiting: rc = 0 00000100:00100000:1.0:1789302357.814306:0:6513:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cc4a9376c00:6513] 0 exiting: rc = 1 00000100:00100000:1.0:1789302357.814421:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.819144:0:10408:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cc38261ea00:10408] 3 exiting: rc = 0 00000100:00100000:0.0:1789302357.820869:0:6515:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cc4a9377c00:6515] 0 exiting: rc = 1 00000100:00100000:0.0:1789302357.820960:0:6517:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cc4a9376600:6517] 2 exiting: rc = 0 00000100:00100000:3.0:1789302357.823405:0:6516:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cc4a9376000:6516] 1 exiting: rc = 0 00000100:00100000:2.0:1789302357.825792:0:13201:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8cc383407e00:13201] 4 exiting: rc = 0 00000100:00100000:1.0:1789302357.826606:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826616:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826622:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826627:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826632:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826637:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826643:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826649:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826666:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826672:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826677:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826683:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826688:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826693:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826709:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826716:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826721:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826728:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826733:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826739:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826745:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826750:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826755:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826760:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826766:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826771:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826776:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826781:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826786:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826791:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826796:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826801:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826807:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826815:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826821:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826826:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826830:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826836:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826840:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826845:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826851:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826856:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826861:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826874:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826879:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826884:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826889:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826894:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826900:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826906:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826912:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826917:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826922:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826927:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826932:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826937:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826942:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826946:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826951:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826956:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826961:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826966:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826972:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.826977:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789302357.834909:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302357.834923:0:15725:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789302357.834940:0:15725:0:(genops.c:885:class_export_put()) final put ffff8cc38380f800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789302357.834945:0:15725:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc38380f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789302357.834951:0:15725:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789302357.835013:0:15725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc382b0f800 1 00000020:00000080:1.0:1789302357.835020:0:15725:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x1ff82925bd399164 00000020:00000080:1.0:1789302357.835026:0:15725:0:(genops.c:885:class_export_put()) final put ffff8cc381fcf000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789302357.835043:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789302357.835055:0:13920:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc381fcf000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789302357.835066:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302357.835071:0:15725:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789302357.835084:0:15725:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff8cc38262cd40) has no exports 00000020:00000080:1.0:1789302357.884996:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302357.885010:0:15725:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789302357.885016:0:15725:0:(genops.c:885:class_export_put()) final put ffff8cc382b09800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789302357.885020:0:15725:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc382b09800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789302357.885026:0:15725:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789302357.886301:0:15725:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cc382b0b000 00000020:01000000:1.0:1789302357.886327:0:15725:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789302357.886333:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302357.886339:0:15725:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789302357.886343:0:15725:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8cc4bd978000) has no exports 00000020:00000080:1.0:1789302357.886372:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302357.887855:0:15725:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789302357.887864:0:15725:0:(genops.c:885:class_export_put()) final put ffff8cc4add8c800/OSS_uuid 00000020:00000080:1.0:1789302357.887869:0:15725:0:(genops.c:844:class_export_destroy()) destroying export ffff8cc4add8c800/OSS_uuid for OSS 00000020:01000000:1.0:1789302357.887876:0:15725:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789302357.888006:0:8852:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8cc38278ba00:8852] 3 exiting: rc = 0 00000100:00080000:0.0:1789302357.888018:0:6526:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789302357.888132:0:8447:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8cc4b52c5c00:8447] 2 exiting: rc = 0 00000100:00100000:0.0:1789302357.888174:0:8446:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8cc4adc16e00:8446] 1 exiting: rc = 0 00000100:00100000:3.0:1789302357.889300:0:8445:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8cc4adc25c00:8445] 0 exiting: rc = 1 00000100:00100000:0.0:1789302357.891232:0:14588:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8cc383932e00:14588] 4 exiting: rc = 0 00000100:00100000:1.0:1789302357.893190:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893203:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893209:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893215:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893222:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893227:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893232:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893238:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893244:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893248:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893254:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893259:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893266:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893274:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893280:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893286:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893310:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893316:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893321:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893326:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893332:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893337:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893343:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893350:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893397:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893404:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893410:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893415:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893420:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893425:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893430:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893435:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893439:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893444:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893449:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893454:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893459:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893463:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893468:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893473:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893478:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893483:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893488:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893493:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893498:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893502:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893508:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893515:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893521:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893528:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893534:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893548:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893553:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893558:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893563:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893568:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893578:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893585:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893590:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893594:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893599:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893605:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893610:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.893620:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302357.895522:0:8448:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cc485d3ac00:8448] 0 exiting: rc = 1 00000100:00100000:0.0:1789302357.895626:0:12212:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8cc381f5c800:12212] 2 exiting: rc = 0 00000100:00100000:3.0:1789302357.898157:0:8449:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cc4adc18a00:8449] 1 exiting: rc = 0 00000100:00100000:1.0:1789302357.898295:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898302:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898309:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898314:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898319:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898324:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898330:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898335:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898339:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898344:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898349:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898353:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898358:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898363:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898369:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898374:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898383:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898389:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898394:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898399:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898404:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898409:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898427:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898433:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898437:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898442:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898446:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898451:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898456:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898461:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898465:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898470:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898475:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898480:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898485:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898490:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898494:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898498:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898503:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898508:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898513:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898518:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898523:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898527:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898532:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898537:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898541:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898546:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898550:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898555:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898559:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898563:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898568:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898573:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898578:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898584:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898589:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898600:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898605:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898610:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898615:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898620:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898624:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.898629:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789302357.899794:0:8452:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cc4adc19c00:8452] 2 exiting: rc = 0 00000100:00100000:3.0:1789302357.899903:0:8450:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cc483379000:8450] 0 exiting: rc = 1 00000100:00100000:1.0:1789302357.900078:0:8451:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cc4adc19000:8451] 1 exiting: rc = 0 00000100:00100000:1.0:1789302357.900190:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900198:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900204:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900210:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900215:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900221:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900226:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900231:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900236:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900241:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900247:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900265:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900272:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900278:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900283:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900289:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900295:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900300:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900305:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900310:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900316:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900321:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900326:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900331:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900337:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900342:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900347:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900363:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900369:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900374:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900379:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900385:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900391:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900397:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900402:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900422:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900428:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900434:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900441:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900446:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900451:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900457:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900462:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900468:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900473:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900478:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900483:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900489:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900495:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900500:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900504:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900510:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900515:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900520:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900525:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900532:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900537:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900543:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900548:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900554:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900569:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900576:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900588:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.900594:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.908328:0:8454:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cc4adc24200:8454] 1 exiting: rc = 0 00000100:00100000:2.0:1789302357.908778:0:8453:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cc4adc24000:8453] 0 exiting: rc = 1 00000100:00100000:1.0:1789302357.909710:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909719:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909724:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909729:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909735:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909740:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909753:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909760:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909765:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909770:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909775:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909780:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909785:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909790:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909795:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909801:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909806:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909812:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909816:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909821:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909827:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909832:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909836:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909841:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909855:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909860:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909865:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909871:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909876:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909881:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909886:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909892:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909908:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909914:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909919:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909925:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909930:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909935:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909940:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909945:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909951:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909956:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909961:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909966:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909971:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909975:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909987:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.909999:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910005:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910010:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910015:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910019:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910024:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910029:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910034:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910038:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910043:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910048:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910053:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910058:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910062:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910067:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910072:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.910077:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302357.911435:0:8456:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cc4adc13e00:8456] 1 exiting: rc = 0 00000100:00100000:3.0:1789302357.911680:0:8455:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cc485d80e00:8455] 0 exiting: rc = 1 00000100:00100000:1.0:1789302357.913231:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913241:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913250:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913271:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913276:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913281:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913287:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913292:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913298:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913304:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913309:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913338:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913345:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913353:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913359:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913366:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913372:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913377:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913383:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913389:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913395:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913401:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913408:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913429:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913435:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913441:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913447:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913453:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913459:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913464:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913470:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913476:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913482:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913488:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913494:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913510:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913517:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913523:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913533:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913539:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913546:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913553:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913559:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913566:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913572:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913577:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913583:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913601:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913607:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913614:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913619:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913626:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913631:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913637:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913643:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913649:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913655:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913660:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913666:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913682:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913688:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913694:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913710:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302357.913722:0:15725:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789302357.930714:0:15725:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789302377.980620:0:16489:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789302388.070544:0:17089:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789302388.070551:0:17089:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789302388.070553:0:17089:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789302388.070668:0:17089:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cc38422d000 00000020:01000004:3.0:1789302388.070683:0:17089:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789302388.070690:0:17089:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789302388.070704:0:17089:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cc38381b380) 00000020:00000080:3.0:1789302388.070716:0:17089:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789302388.152548:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789302388.155671:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.158698:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.159327:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.160165:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789302388.160711:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789302388.161263:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.162237:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.162603:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.162787:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789302388.162968:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789302388.164392:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.166181:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.166582:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789302388.166878:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789302388.169787:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.170249:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.170514:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.171268:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.171553:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.171823:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.172441:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.172780:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.173005:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.173336:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.173622:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.173829:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.174080:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.174480:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.174698:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.174905:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.175287:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.177519:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.177979:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.178343:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.178575:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.178823:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.179019:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.179466:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.179651:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.179820:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.180006:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.180364:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.180634:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.180913:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.181567:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789302388.181965:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1789302388.185382:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.185856:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.186164:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.186755:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.186973:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1789302388.187362:0:17089:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:1.0:1789302388.187913:0:17089:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789302388.188644:0:17089:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789302388.188651:0:17089:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789302388.188664:0:17089:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd39a39a 00000020:01000004:1.0:1789302388.188671:0:17089:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789302388.188676:0:17089:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789302388.188682:0:17089:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cc38422d000 from MGS 00000020:01000004:1.0:1789302388.188686:0:17089:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789302388.188705:0:17089:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cc381fc4d40) 00000020:00000080:1.0:1789302388.188716:0:17089:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789302388.188779:0:17089:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc38422d000 from MGS, refs=2 00080000:01000000:1.0:1789302388.188783:0:17089:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789302388.188788:0:17089:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd39a3a8 00000100:00100000:1.0:1789302388.188889:0:17089:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789302388.189016:0:17089:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789302388.189022:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789302388.189852:0:17089:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789302388.189860:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789302388.195741:0:17089:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302388.195915:0:17089:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789302388.195927:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789302388.196922:0:17089:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789302388.196932:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789302388.197787:0:17089:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789302388.197796:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789302388.198534:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302388.198538:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302388.198540:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302388.198815:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302388.198817:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302388.198818:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302388.203471:0:17089:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789302388.206559:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789302388.215472:0:17089:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789302388.218408:0:17101:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789302388.219190:0:17089:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789302388.219249:0:17089:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789302388.220055:0:17089:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789302388.220674:0:17089:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302388.220849:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789302388.220856:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789302388.230348:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789302388.230366:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789302388.234577:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789302388.234593:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789302388.239079:0:17089:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789302388.239103:0:17089:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.109@tcp' 00000020:01000004:2.0:1789302388.239104:0:17089:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:0.0:1789302388.239148:0:17106:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:2.0:1789302388.239157:0:17089:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.109@tcp (typ=mgc) 00000020:00000080:2.0:1789302388.239310:0:17089:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.109@tcp (ffff8cc4bd978000) 00000020:00000080:2.0:1789302388.239328:0:17089:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789302388.239400:0:17089:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc38433b800@MGC192.168.203.109@tcp: add connection 192.168.203.109@tcp at head 00010000:00010000:2.0:1789302388.239635:0:17089:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.109@tcp-0 is initialized 00000040:01000000:2.0:1789302388.239642:0:17089:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.109@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789302388.246603:0:17107:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789302388.246692:0:17089:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.109@tcp (uuid c46098ed-e570-4ba8-9393-0223b90f3f6e) 00000020:00000080:3.0:1789302388.246717:0:17089:0:(genops.c:1384:class_connect()) connect: client c46098ed-e570-4ba8-9393-0223b90f3f6e, cookie 0x1ff82925bd39a3b6 00000100:00080000:3.0:1789302388.246729:0:17089:0:(import.c:545:import_select_connection()) MGC192.168.203.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302388.246741:0:17089:0:(import.c:666:import_select_connection()) MGC192.168.203.109@tcp: import ffff8cc38433b800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302388.246774:0:17089:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd803100 x1876219121544704/t0(0) o250->MGC192.168.203.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302388.246801:0:17089:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c46098ed-e570-4ba8-9393-0223b90f3f6e->MGS 00000020:01000004:3.0:1789302388.246826:0:17089:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789302388.246830:0:17089:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789302388.246843:0:17089:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cc3838199c0) 00000020:00000080:3.0:1789302388.246855:0:17089:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789302388.249440:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46098ed-e570-4ba8-9393-0223b90f3f6e:3644:1876219121544704:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789302388.249526:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302388.252559:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121544704 00000100:00100000:2.0:1789302388.252579:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121544704 00000100:00100000:2.0:1789302388.252618:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302388.252627:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1876219121544704:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789302388.252652:0:17102:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c46098ed-e570-4ba8-9393-0223b90f3f6e@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1789302388.252679:0:17102:0:(genops.c:1384:class_connect()) connect: client c46098ed-e570-4ba8-9393-0223b90f3f6e, cookie 0x1ff82925bd39a3c4 00000100:00080000:2.0:1789302388.252810:0:17102:0:(import.c:65:import_set_state_nolock()) ffff8cc384338000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302388.252888:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+5:3644:x1876219121544704:12345-0@lo:250:mount.lustre.0 Request processed in 261us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302388.252895:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302388.254514:0:3644:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789302388.254527:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.109@tcp: connect to target with instance 0 00000100:00080000:1.0:1789302388.254536:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789302388.254542:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789302388.254546:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc38433b800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789302388.254550:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789302388.254569:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789302388.254577:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46098ed-e570-4ba8-9393-0223b90f3f6e:3644:1876219121544704:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789302388.262269:0:17089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302388.262513:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789302388.262518:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789302388.265433:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789302388.265447:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789302388.265843:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789302388.265855:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789302388.270516:0:17089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789302388.270683:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789302388.270689:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789302388.274275:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789302388.274291:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789302388.314904:0:17089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302388.315105:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789302388.315236:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789302388.327674:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789302388.327687:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789302388.328413:0:17089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302388.328600:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789302388.328606:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789302388.331945:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789302388.331958:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789302388.332830:0:17089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302388.332994:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789302388.332999:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789302388.334933:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789302388.334945:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789302388.335744:0:17089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302388.335910:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789302388.335916:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789302388.336622:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789302388.336629:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789302388.401950:0:17089:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302388.402245:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789302388.402251:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789302388.404810:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789302388.404824:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789302388.407782:0:17089:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789302388.407796:0:17089:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789302388.412853:0:17089:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789302388.412882:0:17089:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789302388.412889:0:17089:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789302388.412987:0:17089:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.109@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789302388.413026:0:17089:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.109@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789302388.413031:0:17089:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789302388.413036:0:17089:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789302388.413037:0:17089:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302388.413039:0:17089:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302388.413040:0:17089:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302388.413041:0:17089:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302388.413042:0:17089:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789302388.413043:0:17089:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789302388.413045:0:17089:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302388.413046:0:17089:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789302388.413048:0:17089:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789302388.413050:0:17089:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789302388.413052:0:17089:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789302388.413053:0:17089:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302388.413054:0:17089:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302388.413055:0:17089:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302388.413056:0:17089:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302388.413057:0:17089:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789302388.413058:0:17089:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789302388.413059:0:17089:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302388.413060:0:17089:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789302388.413085:0:17089:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789302388.413104:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121544832:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789302388.413201:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302388.413250:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302388.413639:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121544832 00000100:00100000:3.0:1789302388.413648:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121544832 00000100:00100000:3.0:1789302388.413729:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302388.413747:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+5:17089:x1876219121544832:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789302388.413794:0:17105:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789302388.413797:0:17105:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789302388.413800:0:17105:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789302388.415315:0:17126:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789302388.415787:0:17105:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789302388.419192:0:17127:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789302388.419201:0:17127:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789302388.419203:0:17127:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789302388.419206:0:17127:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789302388.421508:0:17127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1789302388.421856:0:17105:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789302388.421867:0:17105:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789302388.424613:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+5:17089:x1876219121544832:12345-0@lo:253:mount.lustre.0 Request processed in 10859us (11402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302388.424637:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302388.424830:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121544832:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789302388.424844:0:17089:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789302388.424847:0:17089:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789302388.424849:0:17089:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789302388.424850:0:17089:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302388.424852:0:17089:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302388.424853:0:17089:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302388.424854:0:17089:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302388.424855:0:17089:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789302388.424862:0:17089:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789302388.424863:0:17089:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302388.424864:0:17089:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789302388.424880:0:17089:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cc38422d000 from lustre-MDT0000 10000000:01000000:1.0:1789302388.424910:0:17089:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789302388.424912:0:17089:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789302388.424916:0:17089:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cc4bd978000 10000000:01000000:1.0:1789302388.424920:0:17089:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789302388.424928:0:17089:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cc4bd978000 from 1 10000000:01000000:1.0:1789302388.424930:0:17089:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789302388.424966:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.424977:0:17089:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.424987:0:17089:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302388.425005:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121544960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789302388.425058:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302388.425091:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302388.425212:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121544960 00000100:00100000:2.0:1789302388.425281:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121544960 00000100:00100000:2.0:1789302388.425354:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302388.425363:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+5:17089:x1876219121544960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302388.425375:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302388.425388:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349a00/0x1ff82925bd39a3d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a3cb expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302388.425411:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349a00/0x1ff82925bd39a3d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a3cb expref: 6 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302388.425421:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5349a00/0x1ff82925bd39a3d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a3cb expref: 6 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302388.425430:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349a00, rc 0) 00000100:00100000:2.0:1789302388.425468:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+6:17089:x1876219121544960:12345-0@lo:101:mount.lustre.0 Request processed in 106us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302388.425474:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302388.425543:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121544960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302388.425555:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.425565:0:17089:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302388.425607:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121545088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302388.425636:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302388.429467:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121545088 00000100:00100000:2.0:1789302388.429506:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121545088 00000100:00100000:1.0:1789302388.429521:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302388.429568:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302388.429580:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+6:17089:x1876219121545088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302388.429832:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+6:17089:x1876219121545088:12345-0@lo:501:mount.lustre.0 Request processed in 255us (4194us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302388.429841:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302388.430006:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121545088:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789302388.430044:0:17089:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789302388.430064:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.430076:0:17089:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302388.430085:0:17089:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cc38422d000 10000000:01000000:1.0:1789302388.430090:0:17089:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789302388.430095:0:17089:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cc38422d000 10000000:01000000:1.0:1789302388.430098:0:17089:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789302388.430101:0:17089:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cc38422d000 from 1 10000000:01000000:1.0:1789302388.430103:0:17089:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789302388.430150:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aae00/0x1ff82925bd39a3d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.430159:0:17089:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc3839aae00/0x1ff82925bd39a3d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.430168:0:17089:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc3839aae00/0x1ff82925bd39a3d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302388.430388:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121545216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789302388.430422:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302388.430445:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302388.430599:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121545216 00000100:00100000:0.0:1789302388.430605:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121545216 00000100:00100000:0.0:1789302388.430687:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789302388.430698:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+6:17089:x1876219121545216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302388.430784:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302388.430802:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48311c400/0x1ff82925bd39a3e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a3d9 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.430825:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48311c400/0x1ff82925bd39a3e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a3d9 expref: 7 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.430835:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48311c400/0x1ff82925bd39a3e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a3d9 expref: 7 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.430844:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311c400, rc 0) 00000100:00100000:0.0:1789302388.430901:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+7:17089:x1876219121545216:12345-0@lo:101:mount.lustre.0 Request processed in 206us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302388.430907:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789302388.430977:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121545216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302388.430997:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc3839aae00/0x1ff82925bd39a3d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3e0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.431006:0:17089:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc3839aae00/0x1ff82925bd39a3d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a3e0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302388.431364:0:17089:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789302388.432071:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aae00/0x1ff82925bd39a3d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3e0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.432079:0:17089:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc3839aae00/0x1ff82925bd39a3d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3e0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302388.432084:0:17089:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789302388.432089:0:17089:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789302388.432093:0:17089:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cc38422d000 10000000:01000000:1.0:1789302388.432095:0:17089:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789302388.432097:0:17089:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789302388.432099:0:17089:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789302388.432456:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48311c600/0x1ff82925bd39a3e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.432466:0:17089:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48311c600/0x1ff82925bd39a3e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.432476:0:17089:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48311c600/0x1ff82925bd39a3e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302388.432505:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121545344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789302388.432552:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302388.432591:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302388.432642:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121545344 00000100:00100000:3.0:1789302388.432649:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121545344 00000100:00100000:3.0:1789302388.432685:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302388.432692:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+7:17089:x1876219121545344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302388.432701:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302388.432784:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39a3ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a3e7 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.432805:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39a3ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a3e7 expref: 8 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.432815:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa983600/0x1ff82925bd39a3ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a3e7 expref: 8 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.432823:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983600, rc 0) 00000100:00100000:3.0:1789302388.432957:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+8:17089:x1876219121545344:12345-0@lo:101:mount.lustre.0 Request processed in 264us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302388.432963:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302388.433084:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121545344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302388.433098:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48311c600/0x1ff82925bd39a3e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3ee expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.433107:0:17089:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48311c600/0x1ff82925bd39a3e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a3ee expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302388.433573:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121545472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302388.433604:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302388.433668:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302388.433772:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121545472 00000100:00100000:3.0:1789302388.433777:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121545472 00000100:00100000:3.0:1789302388.433852:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789302388.433873:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+8:17089:x1876219121545472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302388.434019:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+9:17089:x1876219121545472:12345-0@lo:501:mount.lustre.0 Request processed in 136us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302388.434027:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302388.434081:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121545472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302388.434107:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121545600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789302388.434184:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302388.434527:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302388.434589:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121545600 00000100:00100000:2.0:1789302388.434597:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121545600 00000100:00100000:2.0:1789302388.434621:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302388.434629:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+9:17089:x1876219121545600:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302388.435429:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+9:17089:x1876219121545600:12345-0@lo:503:mount.lustre.0 Request processed in 798us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302388.435438:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302388.435530:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121545600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789302388.436697:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17128:1876219121545728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302388.436824:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302388.436897:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b532c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789302388.436944:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121545728 00000100:00100000:0.0:1789302388.436951:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121545728 00000100:00100000:0.0:1789302388.437092:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789302388.437102:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+9:17128:x1876219121545728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302388.437891:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+9:17128:x1876219121545728:12345-0@lo:502:llog_process_th.0 Request processed in 788us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302388.437900:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789302388.437972:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17128:1876219121545728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302388.438001:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302388.438082:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302388.438085:0:17128:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789302388.438091:0:17128:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789302388.438094:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302388.438107:0:17128:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cc38381cd40) 00000020:00000080:3.0:1789302388.438420:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789302388.438429:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789302388.438520:0:17128:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789302388.438528:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd39a3fc 00000020:00000080:3.0:1789302388.438807:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789302388.438812:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302388.438816:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302388.438817:0:17128:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789302388.438821:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302388.438825:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302388.438826:0:17128:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789302388.438830:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302388.438839:0:17128:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cc383818000) 00000020:00000080:3.0:1789302388.438849:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789302388.438853:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789302388.438862:0:17128:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789302388.438865:0:17128:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789302388.438871:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789302388.438915:0:17128:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc38422d000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789302388.438927:0:17128:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cc38262cd40) 00000020:00000080:3.0:1789302388.438935:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789302388.439000:0:17128:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789302388.439005:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd39a411 00000020:00000080:3.0:1789302388.439501:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789302388.439508:0:17128:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789302388.439513:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1ff82925bd39a418 00080000:01000000:3.0:1789302388.439518:0:17128:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789302388.439521:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd39a41f 00010000:00010000:2.0:1789302388.584559:0:17128:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789302388.585343:0:17128:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1789302388.585647:0:17128:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789302388.586708:0:17128:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cc4bd9799c0) 00000020:00000080:2.0:1789302388.586726:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789302388.586790:0:17128:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789302388.586795:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd39a42d 00000020:00000080:0.0:1789302388.594556:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789302388.605647:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1ff82925bd39a434 00000020:00000080:0.0:1789302388.607163:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789302388.607186:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302388.607193:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302388.607195:0:17128:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789302388.607199:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789302388.607201:0:17128:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789302388.607203:0:17128:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789302388.607204:0:17128:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789302388.607206:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789302388.607209:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302388.607211:0:17128:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789302388.607213:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302388.607331:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302388.607333:0:17128:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789302388.607339:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789302388.607472:0:17128:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789302388.607503:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302388.607507:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302388.607508:0:17128:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789302388.607518:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302388.607522:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302388.607523:0:17128:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789302388.607526:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789302388.607531:0:17128:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:00000080:0.0:1789302388.607557:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789302388.607570:0:17128:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8cc4b50b99c0) 00000020:00000080:0.0:1789302388.607586:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789302388.607591:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789302388.607647:0:17128:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789302388.607653:0:17128:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789302388.607659:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd39a442 00010000:00080000:0.0:1789302388.607689:0:17128:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc491235800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.109@tcp at head 00010000:00010000:2.0:1789302388.614506:0:17128:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789302388.616006:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789302388.616020:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789302388.616051:0:17128:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789302388.616068:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd39a449 00000100:00080000:3.0:1789302388.616406:0:17128:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302388.616418:0:17128:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cc491235800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302388.616451:0:17128:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd801c00 x1876219121545856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302388.616520:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121545856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789302388.616585:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302388.616678:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121545856 00000100:00100000:0.0:1789302388.616685:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121545856 00000100:00100000:0.0:1789302388.616719:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302388.616726:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876219121545856:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789302388.616741:0:17115:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1789302388.620834:0:17128:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1789302388.621378:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302388.621386:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302388.621388:0:17128:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789302388.621392:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789302388.621394:0:17128:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1789302388.621396:0:17128:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302388.621397:0:17128:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302388.621398:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789302388.621400:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302388.621413:0:17128:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789302388.621416:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789302388.621421:0:17128:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789302388.621424:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302388.621426:0:17128:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789302388.621428:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789302388.621431:0:17128:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:01000000:3.0:1789302388.621458:0:17128:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789302388.621460:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302388.621475:0:17128:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cc38262b380) 00000020:00000080:3.0:1789302388.621505:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789302388.621511:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789302388.621604:0:17128:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789302388.621610:0:17128:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789302388.621617:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd39a457 00010000:00080000:3.0:1789302388.621656:0:17128:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc4a04cd000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.109@tcp at head 00010000:00010000:3.0:1789302388.621878:0:17128:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789302388.624599:0:17128:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789302388.625034:0:17128:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789302388.629187:0:17128:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302388.630038:0:17128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789302388.643872:0:17128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:1.0:1789302388.647480:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876219121545856:12345-0@lo:38:llog_process_th.0 Request processed in 30746us (30888us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789302388.647530:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789302388.647869:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc491235800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302388.647875:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789302388.647879:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121545856:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789302388.648673:0:17134:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789302388.648679:0:17134:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789302388.649735:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789302388.649747:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789302388.649780:0:17128:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789302388.649797:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd39a45e 00000100:00080000:2.0:1789302388.649805:0:17128:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789302388.649815:0:17128:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cc4a04cd000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:2.0:1789302388.649847:0:17128:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc384051c00 x1876219121545984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789302388.649873:0:17128:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789302388.649920:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302388.649938:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302388.649940:0:17128:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789302388.649943:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789302388.649946:0:17128:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1789302388.649947:0:17128:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789302388.649949:0:17128:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789302388.649950:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789302388.649952:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302388.649954:0:17128:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789302388.649956:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789302388.649959:0:17128:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789302388.649962:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302388.649963:0:17128:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789302388.649966:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789302388.649970:0:17128:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:01000000:2.0:1789302388.649989:0:17128:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789302388.649991:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789302388.650000:0:17128:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cc4bd97cd40) 00000020:00000080:2.0:1789302388.650011:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789302388.650015:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789302388.650065:0:17128:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789302388.650077:0:17128:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789302388.650083:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1ff82925bd39a46c 00010000:00080000:2.0:1789302388.650108:0:17128:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc486746000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.109@tcp at head 00000100:00100000:0.0:1789302388.651019:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121545984:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789302388.651457:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219121545984 offset 0 length 520: 4 00010000:00010000:2.0:1789302388.651639:0:17128:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789302388.651709:0:17128:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789302388.651725:0:17128:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789302388.656041:0:17128:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302388.656649:0:17128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789302388.657826:0:17128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789302388.659817:0:17136:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789302388.659824:0:17136:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789302388.662456:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789302388.662472:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789302388.662533:0:17128:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789302388.662554:0:17128:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd39a473 00000100:00080000:2.0:1789302388.662564:0:17128:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789302388.662575:0:17128:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cc486746000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:2.0:1789302388.662843:0:17128:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc384051f80 x1876219121546112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789302388.662871:0:17128:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789302388.663067:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302388.663082:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302388.663084:0:17128:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789302388.663089:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302388.663092:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302388.663093:0:17128:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789302388.663096:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789302388.663098:0:17128:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789302388.663101:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302388.663103:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302388.663104:0:17128:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789302388.663106:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302388.663109:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302388.663131:0:17128:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789302388.663136:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789302388.663177:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17128:1876219121546240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302388.663393:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302388.663432:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121546240 00000100:00100000:2.0:1789302388.663439:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121546240 00000100:00100000:2.0:1789302388.663492:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789302388.663502:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+9:17128:x1876219121546240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302388.663615:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+9:17128:x1876219121546240:12345-0@lo:502:llog_process_th.0 Request processed in 113us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302388.663632:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789302388.663678:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383a38480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302388.663700:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17128:1876219121546240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789302388.663723:0:17128:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302388.663728:0:17128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302388.663729:0:17128:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789302388.663732:0:17128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1789302388.664560:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121546112:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789302388.664602:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219121546112 offset 0 length 520: 4 00000020:01000000:0.0:1789302388.664661:0:17089:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789302388.664684:0:17089:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789302388.664707:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48311c600/0x1ff82925bd39a3e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3ee expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.664912:0:17089:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48311c600/0x1ff82925bd39a3e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3ee expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302388.664921:0:17089:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc38422d000 from 1 10000000:01000000:0.0:1789302388.664923:0:17089:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789302388.664957:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.664965:0:17089:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.664976:0:17089:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302388.664993:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121546368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789302388.665026:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302388.665044:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382957000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302388.665066:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121546368 00000100:00100000:0.0:1789302388.665072:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121546368 00000100:00100000:0.0:1789302388.665109:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302388.665152:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+9:17089:x1876219121546368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302388.665163:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302388.665177:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48311de00/0x1ff82925bd39a481 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a47a expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.665208:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48311de00/0x1ff82925bd39a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a47a expref: 10 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.665219:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48311de00/0x1ff82925bd39a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a47a expref: 10 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.665228:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311de00, rc 0) 00000100:00100000:0.0:1789302388.665263:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+10:17089:x1876219121546368:12345-0@lo:101:mount.lustre.0 Request processed in 112us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302388.665269:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302388.665508:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121546368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302388.665593:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302388.665602:0:17089:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302388.666271:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121546496:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789302388.666317:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302388.666385:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302388.666874:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121546496 00000100:00100000:0.0:1789302388.666881:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121546496 00000100:00100000:0.0:1789302388.666931:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302388.666940:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+10:17089:x1876219121546496:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789302388.666960:0:17105:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789302388.666966:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789302388.667330:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+10:17089:x1876219121546496:12345-0@lo:256:mount.lustre.0 Request processed in 390us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302388.667338:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302388.667949:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121546496:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789302388.668817:0:17089:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789302388.669353:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.669369:0:17089:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302388.669379:0:17089:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc38422d000 from 1 10000000:01000000:1.0:1789302388.669389:0:17089:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302388.669425:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.669433:0:17089:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.669444:0:17089:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302388.669463:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121546624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789302388.669524:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302388.669564:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302388.671413:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121546624 00000100:00100000:3.0:1789302388.671427:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121546624 00000100:00100000:3.0:1789302388.671504:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789302388.671572:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+10:17089:x1876219121546624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302388.671589:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302388.671609:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a48f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a488 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.671636:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a48f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a488 expref: 11 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.671661:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a48f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a488 expref: 11 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.671671:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983400, rc 0) 00000100:00100000:1.0:1789302388.671860:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121546624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302388.671877:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.671887:0:17089:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302388.671957:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121546752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302388.672002:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302388.672042:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302388.672098:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121546752 00000100:00100000:0.0:1789302388.672109:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121546752 00000100:00100000:0.0:1789302388.672183:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302388.672192:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17089:x1876219121546752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302388.672307:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17089:x1876219121546752:12345-0@lo:501:mount.lustre.0 Request processed in 117us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302388.672315:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789302388.672518:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+11:17089:x1876219121546624:12345-0@lo:101:mount.lustre.0 Request processed in 1004us (2993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302388.672527:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302388.672531:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121546752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302388.672566:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121546880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302388.672609:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302388.672638:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302388.672895:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121546880 00000100:00100000:2.0:1789302388.672900:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121546880 00000100:00100000:2.0:1789302388.672937:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789302388.672944:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+11:17089:x1876219121546880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302388.673033:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+11:17089:x1876219121546880:12345-0@lo:503:mount.lustre.0 Request processed in 89us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302388.673040:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789302388.673331:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121546880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302388.673892:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17138:1876219121547008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302388.673937:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302388.673971:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc600 going to sleep for 11 seconds 00000100:00100000:3.0:1789302388.674150:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121547008 00000100:00100000:3.0:1789302388.674164:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121547008 00000100:00100000:3.0:1789302388.674195:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789302388.674202:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+11:17138:x1876219121547008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302388.674779:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+11:17138:x1876219121547008:12345-0@lo:502:llog_process_th.0 Request processed in 575us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302388.674788:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789302388.674919:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17138:1876219121547008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302388.674944:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302388.674953:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302388.674955:0:17138:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789302388.674963:0:17138:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc38422d000 00000020:00000080:1.0:1789302388.674966:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789302388.674974:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302388.674976:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302388.674978:0:17138:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789302388.674980:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302388.674983:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302388.674984:0:17138:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789302388.674987:0:17138:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc38422d000 00000020:00000080:1.0:1789302388.674989:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789302388.675086:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302388.675090:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302388.675092:0:17138:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789302388.675094:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302388.675097:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302388.675098:0:17138:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789302388.675140:0:17138:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc38422d000 00000020:00000080:1.0:1789302388.675145:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789302388.682436:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302388.682448:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302388.682451:0:17138:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789302388.682455:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302388.682459:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302388.682461:0:17138:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789302388.682466:0:17138:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc38422d000 00000020:00000080:1.0:1789302388.682468:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789302388.682562:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17138:1876219121547136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302388.682644:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302388.682693:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc600 going to sleep for 11 seconds 00000100:00100000:2.0:1789302388.682830:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121547136 00000100:00100000:2.0:1789302388.682839:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121547136 00000100:00100000:2.0:1789302388.682887:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302388.682898:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+11:17138:x1876219121547136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302388.683025:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+11:17138:x1876219121547136:12345-0@lo:502:llog_process_th.0 Request processed in 128us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302388.683033:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789302388.683538:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17138:1876219121547136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302388.683568:0:17138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302388.683575:0:17138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302388.683576:0:17138:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789302388.683581:0:17138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789302388.688730:0:17089:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789302388.688770:0:17089:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302388.688843:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302388.688855:0:17089:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302388.688923:0:17089:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789302388.688927:0:17089:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cc38422d000 10000000:01000000:2.0:1789302388.688930:0:17089:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cc38422d000 10000000:01000000:2.0:1789302388.688935:0:17089:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789302388.688941:0:17089:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc38422d000 from 1 10000000:01000000:2.0:1789302388.688944:0:17089:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789302388.688992:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349600/0x1ff82925bd39a496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302388.689001:0:17089:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349600/0x1ff82925bd39a496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302388.689010:0:17089:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349600/0x1ff82925bd39a496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302388.689034:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121547264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789302388.689097:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302388.689156:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121547264 00000100:00100000:2.0:1789302388.689171:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383a38900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302388.689305:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121547264 00000100:00100000:3.0:1789302388.689360:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789302388.689371:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+11:17089:x1876219121547264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302388.689384:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302388.689397:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd39a49d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a496 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.689427:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd39a49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a496 expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.689450:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa983200/0x1ff82925bd39a49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a496 expref: 12 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.689458:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983200, rc 0) 00000100:00100000:3.0:1789302388.689517:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17089:x1876219121547264:12345-0@lo:101:mount.lustre.0 Request processed in 148us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302388.689524:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789302388.689535:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121547264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302388.689553:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349600/0x1ff82925bd39a496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a49d expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302388.689563:0:17089:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349600/0x1ff82925bd39a496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a49d expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302388.689617:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121547392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302388.689644:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302388.689668:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383a38900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302388.689685:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121547392 00000100:00100000:2.0:1789302388.689689:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121547392 00000100:00100000:2.0:1789302388.689720:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302388.689730:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17089:x1876219121547392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302388.689859:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17089:x1876219121547392:12345-0@lo:501:mount.lustre.0 Request processed in 132us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302388.689866:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302388.689912:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121547392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302388.689940:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121547520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302388.689999:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302388.690017:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383a38900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302388.690026:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121547520 00000100:00100000:3.0:1789302388.690032:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121547520 00000100:00100000:3.0:1789302388.690070:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302388.690077:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17089:x1876219121547520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789302388.690181:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17089:x1876219121547520:12345-0@lo:503:mount.lustre.0 Request processed in 105us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302388.690188:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789302388.690599:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121547520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302388.691269:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17142:1876219121547648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302388.691470:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302388.691512:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121547648 00000100:00100000:2.0:1789302388.691518:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121547648 00000100:00100000:2.0:1789302388.691558:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789302388.691567:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17142:x1876219121547648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302388.691678:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17142:x1876219121547648:12345-0@lo:502:llog_process_th.0 Request processed in 112us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302388.691686:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789302388.691736:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383a383c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302388.691753:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17142:1876219121547648:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789302388.691813:0:17142:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789302388.697325:0:17142:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cc382628000) 00000020:00000080:3.0:1789302388.697351:0:17142:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789302388.697972:0:17142:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc38422d000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789302388.697978:0:17142:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc38422d000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789302388.697982:0:17142:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc38422d000 4 00010000:00080000:3.0:1789302388.698013:0:17142:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc485d32800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.109@tcp at head 00010000:00010000:3.0:1789302388.711508:0:17142:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789302388.711941:0:17142:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789302388.711988:0:17142:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789302388.712001:0:17142:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1ff82925bd39a4ab 00000100:00080000:3.0:1789302388.712011:0:17142:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302388.712035:0:17142:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cc485d32800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302388.712072:0:17142:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd800700 x1876219121547776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302388.712148:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876219121547776:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789302388.712213:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789302388.712287:0:17142:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789302388.712475:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17142:1876219121547904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302388.712528:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302388.712546:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382767480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302388.712569:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121547904 00000100:00100000:2.0:1789302388.712576:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121547904 00000100:00100000:2.0:1789302388.712617:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789302388.712626:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17142:x1876219121547904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302388.712753:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17142:x1876219121547904:12345-0@lo:502:llog_process_th.0 Request processed in 128us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302388.712761:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789302388.713081:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17142:1876219121547904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302388.713163:0:17142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17142:1876219121548032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302388.713199:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302388.713222:0:17142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382767480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302388.713295:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121547776 00000100:00100000:1.0:1789302388.713301:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121547776 00000100:00100000:1.0:1789302388.713325:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302388.713331:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876219121547776:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789302388.713376:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876219121547776:12345-0@lo:38:llog_process_th.0 Request processed in 44us (1163us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789302388.713383:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302388.713408:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789302388.713415:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc485d32800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789302388.713425:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789302388.713429:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876219121547776:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789302388.713495:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121548032 00000100:00100000:2.0:1789302388.713500:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121548032 00000100:00100000:2.0:1789302388.713532:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789302388.713540:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17142:x1876219121548032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302388.713607:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17142:x1876219121548032:12345-0@lo:502:llog_process_th.0 Request processed in 68us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302388.713614:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789302388.713679:0:17142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c46098ed-e570-4ba8-9393-0223b90f3f6e:17142:1876219121548032:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789302388.713699:0:17142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789302388.713821:0:17089:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789302388.713917:0:17089:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302388.713936:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349600/0x1ff82925bd39a496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a49d expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302388.713946:0:17089:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349600/0x1ff82925bd39a496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a49d expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789302388.714056:0:17089:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789302388.714058:0:17089:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789302388.714060:0:17089:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302388.714061:0:17089:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302388.714063:0:17089:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302388.714064:0:17089:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302388.714065:0:17089:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302388.714067:0:17089:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789302388.714072:0:17089:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302388.714073:0:17089:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302388.714076:0:17089:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789302388.714078:0:17089:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302388.714079:0:17089:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789302388.714080:0:17089:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302388.714081:0:17089:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302388.714082:0:17089:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302388.714083:0:17089:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302388.714084:0:17089:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302388.714085:0:17089:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789302388.714086:0:17089:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302388.714087:0:17089:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302388.714101:0:17089:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789302388.714585:0:17089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121548160:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789302388.714629:0:17089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302388.714662:0:17089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383a38b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302388.714712:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121548160 00000100:00100000:3.0:1789302388.714717:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121548160 00000100:00100000:3.0:1789302388.714792:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789302388.714800:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17089:x1876219121548160:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789302388.714821:0:17104:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789302388.714846:0:17104:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789302388.718360:0:17104:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789302388.718374:0:17104:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789302388.718449:0:17126:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789302388.718454:0:17126:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789302388.718475:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.718504:0:17126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48311de00/0x1ff82925bd39a481 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a47a expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.718525:0:17126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.718565:0:17126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48311de00/0x1ff82925bd39a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a47a expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.718928:0:17126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc48311de00/0x1ff82925bd39a481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a47a expref: 12 pid: 17105 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302388.718948:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121548288:0@lo:104: 00000100:00100000:3.0:1789302388.719007:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302388.719055:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382767480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302388.719410:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121548288 00000100:00100000:1.0:1789302388.719419:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121548288 00000100:00100000:1.0:1789302388.719472:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302388.719480:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:17126:x1876219121548288:12345-0@lo:104: 00010000:00010000:1.0:1789302388.719503:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.719556:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789302388.719562:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:17126:x1876219121548288:12345-0@lo:104: Request processed in 84us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302388.719569:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789302388.719589:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302388.719596:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.719603:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311c800 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302388.719607:0:17099:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.719616:0:17099:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302388.719622:0:17099:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302388.719628:0:17099:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302388.719655:0:17099:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.719668:0:17099:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302388.719688:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.719695:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48311c800/0x1ff82925bd39a47a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a481 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302388.719709:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302388.719711:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302388.719850:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121548288:0@lo:104: 00010000:00010000:3.0:1789302388.719870:0:17126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302388.719924:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17089:x1876219121548160:12345-0@lo:253:mount.lustre.0 Request processed in 5125us (5294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302388.719933:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789302388.719976:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302388.720010:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121548416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302388.720040:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302388.720158:0:17089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17089:1876219121548160:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789302388.720169:0:17089:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789302388.720172:0:17089:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789302388.720174:0:17089:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789302388.720175:0:17089:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302388.720176:0:17089:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302388.720177:0:17089:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302388.720178:0:17089:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302388.720180:0:17089:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302388.720181:0:17089:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789302388.720183:0:17089:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302388.720184:0:17089:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789302388.720195:0:17089:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789302388.722951:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121548416 00000100:00100000:3.0:1789302388.722966:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121548416 00010000:00010000:3.0:1789302388.723004:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48311de00/0x1ff82925bd39a481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a47a expref: 12 pid: 17105 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302388.723095:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302388.723108:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:3647:x1876219121548416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302388.723138:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302388.723152:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48311de00/0x1ff82925bd39a481 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a47a expref: 12 pid: 17105 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723165:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48311de00/0x1ff82925bd39a481 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a47a expref: 12 pid: 17105 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723183:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48311de00/0x1ff82925bd39a481 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a47a expref: 12 pid: 17105 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723199:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723206:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789302388.723222:0:17095:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004768244s 00010000:00010000:3.0:1789302388.723226:0:17095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723233:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723240:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723246:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723252:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982e00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302388.723256:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723275:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723293:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723304:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302388.723377:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+11:3647:x1876219121548416:12345-0@lo:103:ldlm_bl.0 Request processed in 272us (3334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302388.723384:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302388.723938:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121548416:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302388.723970:0:17126:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723979:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302388.723984:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a4b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789302388.748468:0:17089:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789302388.749561:0:17089:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789302388.750645:0:17150:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789302388.750675:0:17089:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:2.0:1789302388.751019:0:17149:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789302388.751025:0:17149:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1789302388.751050:0:17150:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1789302388.752182:0:17151:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8cc3843ee680 x1876219121548544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302388.752196:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00000040:01000000:3.0:1789302388.752992:0:17089:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789302388.753242:0:17089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789302388.754341:0:17089:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789302388.754435:0:17089:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789302388.754628:0:17089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302388.757095:0:17089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789302388.758346:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789302388.758401:0:17150:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1789302388.759107:0:17089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789302388.759348:0:17089:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789302388.763798:0:17089:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1789302388.768058:0:17089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789302388.770271:0:17089:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789302388.770307:0:17089:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadc441c37988 00100000:10000000:0.0:1789302388.770315:0:17089:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789302388.771433:0:17089:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789302388.771448:0:17089:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789302388.771468:0:17089:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789302388.771495:0:17089:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789302388.784357:0:17089:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302388.784636:0:17089:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789302389.268973:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789302389.716302:0:17107:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789302389.716310:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc38422d000 from 7 10000000:01000000:3.0:1789302389.716315:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789302389.716367:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302389.716392:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302389.716404:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302389.716428:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121548672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789302389.716503:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302389.716609:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3828cbd80 going to sleep for 11 seconds 00000040:00080000:1.0:1789302389.720166:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789302389.722255:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121548672 00000100:00100000:0.0:1789302389.722269:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121548672 00000100:00100000:1.0:1789302389.722451:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789302389.722463:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+11:17107:x1876219121548672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302389.722488:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302389.722513:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a4c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a4b9 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302389.722560:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a4c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a4b9 expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302389.722571:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a4c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a4b9 expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302389.722581:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839abe00, rc 0) 00000100:00100000:1.0:1789302389.722953:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17107:x1876219121548672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 491us (6449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302389.722960:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789302389.723017:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121548672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302389.723037:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302389.723050:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302389.723147:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121548800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789302389.723969:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302389.724017:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3828cbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302389.724151:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121548800 00000100:00100000:0.0:1789302389.724159:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121548800 00000100:00100000:0.0:1789302389.724215:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789302389.724225:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17107:x1876219121548800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789302389.724245:0:17104:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789302389.724264:0:17104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789302389.724268:0:17104:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789302389.724378:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17107:x1876219121548800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302389.724391:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789302389.724433:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121548800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789302389.724490:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789302389.724499:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302389.724509:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302389.781269:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:0.0:1789302390.293272:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302390.747774:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789302390.805510:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:2.0:1789302391.323592:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302391.831306:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:0.0:1789302392.342958:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302392.852670:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:3.0:1789302393.365396:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789302393.540615:0:17393:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789302393.876493:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00000100:00080000:1.0:1789302393.941690:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789302393.941697:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789302393.941700:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc491235800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302393.941708:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 464 00000100:00080000:1.0:1789302393.941714:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789302393.941726:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cc491235800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302393.941746:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc3843ee300 x1876219121549056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302393.941760:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302393.941763:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789302393.941766:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302393.941781:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789302393.941784:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789302393.941788:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789302393.941790:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc485d32800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302393.941797:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cc485d32800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302393.941811:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc3843ef480 x1876219121549184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302393.941837:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121548928:0@lo:400:kworker.0 00000100:00100000:1.0:1789302393.941903:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302393.942071:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121548928 00000100:00100000:0.0:1789302393.942078:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121548928 00000100:00100000:0.0:1789302393.942153:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302393.942163:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:3648:x1876219121548928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302393.942216:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:3648:x1876219121548928:12345-0@lo:400:kworker.0 Request processed in 55us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302393.942223:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302393.942254:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121549056:0@lo:38:kworker.0 00000100:00100000:0.0:1789302393.942280:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302393.942300:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876219121549184:0@lo:38:kworker.0 00000100:00100000:0.0:1789302393.942326:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302393.942370:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121549056 00000100:00100000:0.0:1789302393.942380:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121549056 00000100:00100000:0.0:1789302393.942400:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302393.942404:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876219121549056:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789302393.942420:0:17116:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789302393.944335:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121549184 00000100:00100000:1.0:1789302393.944346:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121549184 00000100:00100000:1.0:1789302393.944615:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302393.944623:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121549184:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789302393.944649:0:17112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:1.0:1789302393.944689:0:17112:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1ff82925bd39a4c7 00000004:00100000:1.0:1789302393.944704:0:17112:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789302393.944852:0:17112:0:(import.c:65:import_set_state_nolock()) ffff8cc4add8c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302393.944926:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876219121549184:12345-0@lo:38:kworker.0 Request processed in 302us (2598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302393.944933:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302393.951030:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121548928:0@lo:400:kworker.0 00010000:00080000:1.0:1789302393.952289:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cc3843ef480 x1876219121549184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789302393.952310:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789302393.952318:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789302393.952323:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789302393.952342:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc485d32800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789302393.952349:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876219121549184:0@lo:38:kworker.0 00000100:00100000:0.0:1789302393.962883:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876219121549056:12345-0@lo:38:kworker.0 Request processed in 20469us (20593us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789302393.962896:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789302393.963017:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc491235800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302393.963023:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789302393.963027:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121549056:0@lo:38:kworker.0 00010000:00010000:0.0:1789302394.388732:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789302394.460886:0:17446:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302394.461531:0:17446:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789302394.901327:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:3.0:1789302395.412244:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789302395.485919:0:17496:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789302395.486233:0:17496:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789302395.926975:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:0.0:1789302396.443649:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302396.948231:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:3.0:1789302397.461864:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302397.972697:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00000100:00100000:2.0:1789302398.036430:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302388/real 1789302388] req@ffff8cc384051f80 x1876219121546112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302398 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302398.036461:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc384051f80 x1876219121546112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302398 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302398.036471:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302388/real 1789302388] req@ffff8cc384051c00 x1876219121545984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302398 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302398.036483:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc384051c00 x1876219121545984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302398 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789302398.036499:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc486746000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302398.036514:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789302398.036517:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121546112:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789302398.036523:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4a04cd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302398.036528:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789302398.036531:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121545984:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789302398.037532:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789302398.037537:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789302398.037540:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc491235800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302398.037546:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1789302398.037551:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789302398.037562:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cc491235800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302398.037584:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc485d50a80 x1876219121549440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789302398.037598:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121549312:0@lo:400:kworker.0 00000100:00080000:0.0:1789302398.037600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302398.037603:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789302398.037604:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc4a04cd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302398.037607:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 464 00000100:00080000:0.0:1789302398.037610:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789302398.037613:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cc4a04cd000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302398.037622:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc485d53480 x1876219121549568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789302398.037638:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302398.037641:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789302398.037643:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc486746000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302398.037645:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 464 00000100:00080000:0.0:1789302398.037647:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789302398.037651:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cc486746000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302398.037662:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc485d53800 x1876219121549696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789302398.037663:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302398.037693:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121549440:0@lo:38:kworker.0 00000100:00100000:0.0:1789302398.037722:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302398.037765:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121549568:0@lo:8:kworker.0 00000400:00000100:0.0:1789302398.037781:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219121549568 offset 0 length 520: 4 00000100:00100000:0.0:1789302398.037798:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121549696:0@lo:8:kworker.0 00000400:00000100:0.0:1789302398.037812:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219121549696 offset 0 length 520: 4 00000100:00100000:0.0:1789302398.037838:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121549440 00000100:00100000:0.0:1789302398.037845:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121549440 00000100:00100000:0.0:1789302398.037875:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789302398.037883:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876219121549440:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789302398.037898:0:17115:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789302398.038276:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302398.038292:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121549824:0@lo:400:kworker.0 00000100:00100000:2.0:1789302398.038327:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302398.038365:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121549312 00000100:00100000:2.0:1789302398.038370:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121549312 00000100:00100000:2.0:1789302398.038402:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789302398.038409:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:3645:x1876219121549312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302398.038465:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:3645:x1876219121549312:12345-0@lo:400:kworker.0 Request processed in 56us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302398.038471:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789302398.038514:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121549312:0@lo:400:kworker.0 00000100:00100000:1.0:1789302398.039200:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121549824 00000100:00100000:1.0:1789302398.039207:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121549824 00000100:00100000:1.0:1789302398.039237:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302398.039244:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121549824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302398.039300:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121549824:12345-0@lo:400:kworker.0 Request processed in 56us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302398.039306:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789302398.039562:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cc485d52300 x1876219121549824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302398.039576:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121549824:0@lo:400:kworker.0 00000100:00100000:1.0:1789302398.059864:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876219121549440:12345-0@lo:38:kworker.0 Request processed in 21973us (22133us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789302398.059877:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789302398.059932:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc491235800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302398.059938:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789302398.059943:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121549440:0@lo:38:kworker.0 00010000:00010000:1.0:1789302398.484907:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302398.999395:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:0.0:1789302399.512461:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302400.020646:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:0.0:1789302400.536884:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302400.980892:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789302401.046622:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:0.0:1789302401.556550:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302402.068218:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00000020:01000004:1.0:1789302402.341882:0:17841:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789302402.341885:0:17841:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789302402.341887:0:17841:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789302402.341995:0:17841:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cc4b5eab000 00000020:01000004:1.0:1789302402.342009:0:17841:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1789302402.342019:0:17841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789302402.342032:0:17841:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8cc381fc0000) 00000020:00000080:1.0:1789302402.342047:0:17841:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789302402.440905:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1789302402.442933:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789302402.443778:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789302402.444418:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789302402.446378:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789302402.446840:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789302402.447823:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789302402.448934:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789302402.449781:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789302402.450408:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789302402.450778:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789302402.451435:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789302402.452064:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789302402.453061:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789302402.463354:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789302402.464317:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789302402.464640:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789302402.465192:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789302402.465510:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789302402.465769:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.466770:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.467276:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.468576:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.469491:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.470475:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.470908:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.471638:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.471908:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.472229:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.472515:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.472761:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.473147:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.473412:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.473673:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.473938:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.474563:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.474841:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.475140:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.475570:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.475888:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.476234:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.476610:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.476901:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.477418:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789302402.477599:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789302402.477852:0:17841:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00080000:01000000:2.0:1789302402.481752:0:17841:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789302402.482894:0:17841:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789302402.482908:0:17841:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789302402.482924:0:17841:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd39a4d5 00000020:01000004:2.0:1789302402.482934:0:17841:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789302402.482956:0:17841:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.109@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789302402.482959:0:17841:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789302402.484226:0:17841:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789302402.484267:0:17841:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789302402.484272:0:17841:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.109@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789302402.495727:0:17841:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789302402.495779:0:17841:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.109@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789302402.495784:0:17841:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789302402.495785:0:17841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789302402.495787:0:17841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302402.495788:0:17841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302402.495789:0:17841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302402.495790:0:17841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302402.495791:0:17841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302402.495792:0:17841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302402.495793:0:17841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789302402.495798:0:17841:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789302402.495800:0:17841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302402.495801:0:17841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789302402.495802:0:17841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302402.495803:0:17841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302402.495804:0:17841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302402.495805:0:17841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302402.495806:0:17841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302402.495807:0:17841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302402.495808:0:17841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789302402.495834:0:17841:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789302402.495856:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121549952:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789302402.495951:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302402.496444:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121549952 00000100:00100000:1.0:1789302402.496453:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121549952 00000100:00100000:2.0:1789302402.496462:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b87b60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302402.496513:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789302402.496523:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17841:x1876219121549952:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789302402.496554:0:17104:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789302402.496565:0:17104:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789302402.496573:0:17104:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789302402.496897:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17841:x1876219121549952:12345-0@lo:253:mount.lustre.0 Request processed in 374us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302402.496905:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789302402.497790:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121549952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789302402.497803:0:17841:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789302402.497806:0:17841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789302402.497808:0:17841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789302402.497810:0:17841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302402.497811:0:17841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302402.497812:0:17841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302402.497814:0:17841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302402.497815:0:17841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302402.497817:0:17841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302402.497818:0:17841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789302402.497837:0:17841:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cc4b5eab000 from lustre-MDT0001 10000000:01000000:2.0:1789302402.497865:0:17841:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789302402.497877:0:17841:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789302402.497884:0:17841:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cc4bd978000 local copy 00010000:00010000:2.0:1789302402.497894:0:17841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302402.497991:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302402.498032:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302402.498070:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b87b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302402.498768:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121550080 00000100:00100000:1.0:1789302402.498775:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121550080 00000100:00100000:1.0:1789302402.498818:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789302402.498827:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17841:x1876219121550080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302402.498960:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17841:x1876219121550080:12345-0@lo:501:mount.lustre.0 Request processed in 134us (926us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302402.498968:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789302402.500830:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550080:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789302402.500861:0:17841:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789302402.500905:0:17841:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789302402.500913:0:17841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.500924:0:17841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302402.500957:0:17841:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cc4b5eab000 10000000:01000000:0.0:1789302402.500962:0:17841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789302402.500967:0:17841:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cc4bd978000 10000000:01000000:0.0:1789302402.500970:0:17841:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789302402.500974:0:17841:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cc4bd978000 from 1 10000000:01000000:0.0:1789302402.500976:0:17841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789302402.501010:0:17841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48311cc00/0x1ff82925bd39a4dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.501019:0:17841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48311cc00/0x1ff82925bd39a4dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.501029:0:17841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48311cc00/0x1ff82925bd39a4dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302402.501049:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789302402.501098:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.501162:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302402.501290:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121550208 00000100:00100000:1.0:1789302402.501297:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121550208 00000100:00100000:1.0:1789302402.501333:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789302402.501340:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc49921ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+12:17841:x1876219121550208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302402.501351:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302402.501364:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc3839abc00/0x1ff82925bd39a4e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a4dc expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302402.501399:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc3839abc00/0x1ff82925bd39a4e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a4dc expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302402.501411:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc3839abc00/0x1ff82925bd39a4e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a4dc expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302402.501420:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839abc00, rc 0) 00000100:00100000:1.0:1789302402.501463:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc49921ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+13:17841:x1876219121550208:12345-0@lo:101:mount.lustre.0 Request processed in 123us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302402.501479:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789302402.501551:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302402.501563:0:17841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48311cc00/0x1ff82925bd39a4dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4e3 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.501573:0:17841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48311cc00/0x1ff82925bd39a4dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a4e3 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302402.501588:0:17841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789302402.501606:0:17841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48311cc00/0x1ff82925bd39a4dc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4e3 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.501614:0:17841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48311cc00/0x1ff82925bd39a4dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4e3 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302402.501622:0:17841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cc4b5eab000 10000000:01000000:2.0:1789302402.501626:0:17841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789302402.501629:0:17841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cc4b5eab000 from 1 10000000:01000000:2.0:1789302402.501631:0:17841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789302402.501645:0:17841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348600/0x1ff82925bd39a4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.501673:0:17841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348600/0x1ff82925bd39a4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.501683:0:17841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348600/0x1ff82925bd39a4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302402.501695:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789302402.501723:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302402.501754:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b87b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302402.501811:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121550336 00000100:00100000:3.0:1789302402.501816:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121550336 00000100:00100000:3.0:1789302402.501888:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789302402.501896:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc49921b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+13:17841:x1876219121550336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302402.501903:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302402.501911:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39a4f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a4ea expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.501925:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39a4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a4ea expref: 14 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.501942:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa983e00/0x1ff82925bd39a4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a4ea expref: 14 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.501948:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983e00, rc 0) 00000100:00100000:3.0:1789302402.501979:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc49921b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+14:17841:x1876219121550336:12345-0@lo:101:mount.lustre.0 Request processed in 84us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302402.501985:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789302402.502153:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302402.502165:0:17841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348600/0x1ff82925bd39a4ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4f1 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.502173:0:17841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348600/0x1ff82925bd39a4ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a4f1 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302402.502185:0:17841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789302402.502189:0:17841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348600/0x1ff82925bd39a4ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4f1 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.502197:0:17841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348600/0x1ff82925bd39a4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4f1 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302402.502203:0:17841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789302402.502207:0:17841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789302402.502212:0:17841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cc4b5eab000 10000000:01000000:2.0:1789302402.502214:0:17841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789302402.502223:0:17841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789302402.502225:0:17841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789302402.502242:0:17841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348000/0x1ff82925bd39a4f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.502248:0:17841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348000/0x1ff82925bd39a4f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.502256:0:17841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348000/0x1ff82925bd39a4f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302402.502268:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789302402.502293:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302402.502308:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b87b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302402.502364:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121550464 00000100:00100000:3.0:1789302402.502368:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121550464 00000100:00100000:3.0:1789302402.502403:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302402.502409:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc49921b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+14:17841:x1876219121550464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302402.502415:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302402.502423:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39a4ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a4f8 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.502435:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39a4ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a4f8 expref: 15 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.502442:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa982a00/0x1ff82925bd39a4ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a4f8 expref: 15 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.502449:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982a00, rc 0) 00000100:00100000:3.0:1789302402.502477:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc49921b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+15:17841:x1876219121550464:12345-0@lo:101:mount.lustre.0 Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302402.502482:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302402.502557:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302402.502567:0:17841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348000/0x1ff82925bd39a4f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4ff expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.502575:0:17841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348000/0x1ff82925bd39a4f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a4ff expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789302402.511964:0:17841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1789302402.513335:0:17841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302402.522192:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789302402.522247:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789302402.522264:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789302402.522276:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789302402.522290:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1789302402.522303:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1789302402.522316:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1789302402.522328:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789302402.522341:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789302402.522355:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1789302402.522372:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1789302402.522386:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1789302402.522915:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1789302402.522935:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789302402.522949:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789302402.522961:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1789302402.522973:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789302402.522986:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789302402.523001:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1789302402.523014:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789302402.523026:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789302402.523037:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789302402.523054:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789302402.523081:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1789302402.523087:0:17841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1789302402.523217:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302402.523284:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302402.523384:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc483b37c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302402.527128:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121550592 00000100:00100000:3.0:1789302402.527142:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121550592 00000100:00100000:3.0:1789302402.527265:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789302402.527275:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc499219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+15:17841:x1876219121550592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302402.527471:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc499219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+15:17841:x1876219121550592:12345-0@lo:501:mount.lustre.0 Request processed in 197us (4186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302402.527480:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789302402.527568:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302402.527615:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302402.527658:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302402.530963:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc483b37c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302402.536924:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121550720 00000100:00100000:2.0:1789302402.536942:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121550720 00000100:00100000:1.0:1789302402.537173:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789302402.537185:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc499219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+15:17841:x1876219121550720:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789302402.544756:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc499219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+15:17841:x1876219121550720:12345-0@lo:503:mount.lustre.0 Request processed in 7562us (17085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.544772:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789302402.551710:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789302402.552184:0:17841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789302402.552291:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302402.552361:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302402.552414:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc483b37c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302402.552511:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121550848 00000100:00100000:3.0:1789302402.552518:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121550848 00000100:00100000:3.0:1789302402.552562:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302402.552571:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc483dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+15:17841:x1876219121550848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302402.556911:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc483dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+15:17841:x1876219121550848:12345-0@lo:502:mount.lustre.0 Request processed in 4332us (4542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302402.556926:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789302402.557047:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789302402.557309:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789302402.557341:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1789302402.557357:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1789302402.557369:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1789302402.557385:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1789302402.557412:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1789302402.557427:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1789302402.557440:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1789302402.557453:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1789302402.557465:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1789302402.557478:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1789302402.557493:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1789302402.557506:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1789302402.557518:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1789302402.557530:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1789302402.557557:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1789302402.557572:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1789302402.557585:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1789302402.557601:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1789302402.557615:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1789302402.557629:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1789302402.557642:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1789302402.557655:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1789302402.557669:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1789302402.557684:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1789302402.557698:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1789302402.557712:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1789302402.557725:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1789302402.557736:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1789302402.557749:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1789302402.557761:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1789302402.557773:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1789302402.557786:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1789302402.557800:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1789302402.557814:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1789302402.557827:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1789302402.557840:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1789302402.557853:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1789302402.557866:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1789302402.557879:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1789302402.557893:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1789302402.557906:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1789302402.557919:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1789302402.557931:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1789302402.557971:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302402.558026:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302402.558247:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc483b37c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302402.562294:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121550976 00000100:00100000:0.0:1789302402.562308:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121550976 00000100:00100000:0.0:1789302402.562426:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789302402.562437:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc483dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+15:17841:x1876219121550976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789302402.562609:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc483dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+15:17841:x1876219121550976:12345-0@lo:502:mount.lustre.0 Request processed in 173us (4581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.562616:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789302402.562703:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121550976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302402.562786:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1789302402.562800:0:17841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789302402.567050:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302402.567065:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.567067:0:17845:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789302402.567078:0:17845:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789302402.567081:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789302402.567095:0:17845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8cc4bd97b380) 00000020:00000080:2.0:1789302402.567141:0:17845:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1789302402.567148:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789302402.567229:0:17845:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789302402.567237:0:17845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd39a50d 00000020:00000080:2.0:1789302402.567445:0:17845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789302402.567449:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302402.567453:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.567454:0:17845:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789302402.567457:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302402.567460:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.567461:0:17845:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789302402.567465:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789302402.567472:0:17845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8cc4aa93b380) 00000020:00000080:2.0:1789302402.567483:0:17845:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1789302402.567486:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789302402.567488:0:17845:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789302402.567491:0:17845:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789302402.567497:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789302402.567552:0:17845:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc4b5eab000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789302402.567564:0:17845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8cc4aa938000) 00000020:00000080:2.0:1789302402.567572:0:17845:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1789302402.567636:0:17845:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789302402.567644:0:17845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd39a522 00000020:00000080:2.0:1789302402.567747:0:17845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789302402.567753:0:17845:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789302402.567757:0:17845:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x1ff82925bd39a529 00080000:01000000:2.0:1789302402.567763:0:17845:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789302402.567766:0:17845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd39a530 00010000:00010000:0.0:1789302402.589584:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302402.751666:0:17845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1789302402.752511:0:17845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1789302402.753486:0:17845:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789302402.755666:0:17845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789302402.755679:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302402.755695:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.755698:0:17845:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789302402.755702:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302402.755707:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.755709:0:17845:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789302402.755712:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789302402.755718:0:17845:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:00000080:2.0:1789302402.755743:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789302402.755758:0:17845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8cc4aa93cd40) 00000020:00000080:2.0:1789302402.755777:0:17845:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789302402.755783:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789302402.755866:0:17845:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789302402.755872:0:17845:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789302402.755879:0:17845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd39a53e 00010000:00080000:2.0:1789302402.755911:0:17845:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc38380a000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.109@tcp at head 00010000:00010000:3.0:1789302402.760208:0:17845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1789302402.770216:0:17845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789302402.770233:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789302402.770275:0:17845:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789302402.770295:0:17845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd39a545 00000100:00080000:3.0:1789302402.770304:0:17845:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302402.770316:0:17845:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cc38380a000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302402.770557:0:17845:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd800e00 x1876219121551104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302402.770617:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121551104:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789302402.770727:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302402.770827:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121551104 00000100:00100000:1.0:1789302402.770835:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121551104 00000100:00100000:1.0:1789302402.770878:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302402.770885:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876219121551104:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789302402.770918:0:17116:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:1.0:1789302402.770959:0:17116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd39a54c 00000004:00100000:1.0:1789302402.770973:0:17116:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789302402.770979:0:17116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789302402.771069:0:17845:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789302402.771164:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302402.771169:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.771172:0:17845:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789302402.771175:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789302402.771179:0:17845:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789302402.771181:0:17845:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302402.771189:0:17845:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302402.771191:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789302402.771194:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.771195:0:17845:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789302402.771198:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302402.771202:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.771204:0:17845:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789302402.771207:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789302402.771254:0:17845:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789302402.771266:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302402.771269:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.771271:0:17845:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789302402.771274:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789302402.771275:0:17845:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1789302402.771276:0:17845:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302402.771277:0:17845:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302402.771279:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789302402.771281:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.771282:0:17845:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789302402.771285:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789302402.771288:0:17845:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789302402.771291:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.771292:0:17845:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789302402.771295:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789302402.771299:0:17845:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:01000000:3.0:1789302402.771319:0:17845:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789302402.771321:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302402.771333:0:17845:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8cc3826299c0) 00000020:00000080:3.0:1789302402.771490:0:17845:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789302402.771500:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789302402.771561:0:17845:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789302402.771567:0:17845:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789302402.771573:0:17845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd39a55a 00010000:00080000:3.0:1789302402.771604:0:17845:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc4b5208000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.109@tcp at head 00010000:00010000:3.0:1789302402.771809:0:17845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1789302402.772770:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789302402.772776:0:13920:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789302402.772780:0:13920:0:(import.c:65:import_set_state_nolock()) ffff8cc491235800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302402.772786:0:13920:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:1.0:1789302402.772792:0:13920:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789302402.772800:0:13920:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cc491235800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302402.772830:0:13920:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc3843ed880 x1876219121551232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:2.0:1789302402.773364:0:17845:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789302402.773604:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121551232:0@lo:38:kworker.0 00000100:00100000:0.0:1789302402.773665:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.773715:0:17115:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000040:01000000:2.0:1789302402.773721:0:17845:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1789302402.773725:0:17115:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789302402.776134:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121551232 00000100:00100000:0.0:1789302402.776146:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121551232 00000100:00100000:2.0:1789302402.776925:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302402.776936:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876219121551232:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789302402.777041:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876219121551232:12345-0@lo:38:kworker.0 Request processed in 105us (3375us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789302402.777048:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789302402.778489:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789302402.778500:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc491235800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302402.778505:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789302402.778509:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121551232:0@lo:38:kworker.0 00000040:00080000:3.0:1789302402.779456:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1789302402.779866:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302402.779872:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789302402.779875:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302402.779877:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789302402.779940:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302402.779958:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121551360:0@lo:400:kworker.0 00000100:00100000:1.0:1789302402.780024:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302402.780351:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121551360 00000100:00100000:2.0:1789302402.780360:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121551360 00000100:00100000:2.0:1789302402.780420:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302402.780430:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121551360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302402.780485:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121551360:12345-0@lo:400:kworker.0 Request processed in 57us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302402.780492:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789302402.781797:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cc3843efb80 x1876219121551360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302402.781812:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121551360:0@lo:400:kworker.0 00000040:00080000:1.0:1789302402.781862:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789302402.782015:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:3.0:1789302402.784355:0:17116:0:(import.c:65:import_set_state_nolock()) ffff8cc4b520e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302402.784465:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876219121551104:12345-0@lo:38:llog_process_th.0 Request processed in 13576us (13736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302402.784481:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302402.784636:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789302402.784646:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789302402.784667:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789302402.784673:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789302402.784676:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc38380a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789302402.784695:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121551104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789302402.784831:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121551488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302402.784873:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302402.785051:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121551488 00000100:00100000:2.0:1789302402.785064:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121551488 00000100:00100000:2.0:1789302402.785149:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302402.785158:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1876219121551488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302402.785184:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789302402.785828:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1876219121551488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 669us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302402.785837:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:1.0:1789302402.787516:0:17851:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789302402.787524:0:17851:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789302402.788830:0:17845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789302402.788844:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789302402.788883:0:17845:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789302402.788906:0:17845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd39a561 00000100:00080000:3.0:1789302402.788918:0:17845:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302402.788931:0:17845:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cc4b5208000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302402.788965:0:17845:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd802680 x1876219121551616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789302402.789026:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121551616:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789302402.789099:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219121551616 offset 0 length 520: 4 00000100:00080000:3.0:1789302402.789289:0:17845:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789302402.789350:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302402.789355:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.789357:0:17845:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789302402.789360:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789302402.789363:0:17845:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1789302402.789365:0:17845:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302402.789366:0:17845:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302402.789367:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789302402.789370:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.789371:0:17845:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789302402.789374:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789302402.789378:0:17845:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789302402.789404:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.789406:0:17845:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789302402.789409:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789302402.789413:0:17845:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.109@tcp to nid 0x20000c0a8cb6d (192.168.203.109@tcp) 00000020:01000000:3.0:1789302402.789440:0:17845:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789302402.789443:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302402.789461:0:17845:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8cc4bd3419c0) 00000020:00000080:3.0:1789302402.789474:0:17845:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789302402.789480:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789302402.789533:0:17845:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789302402.789539:0:17845:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789302402.789544:0:17845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x1ff82925bd39a56f 00010000:00080000:3.0:1789302402.789572:0:17845:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc4b5138800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.109@tcp at head 00010000:00010000:3.0:1789302402.789765:0:17845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789302402.789831:0:17845:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789302402.789846:0:17845:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1789302402.790607:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302402.790614:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789302402.790616:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302402.790619:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789302402.791744:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302402.791959:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789302402.792248:0:17845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789302402.792817:0:17853:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789302402.792822:0:17853:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789302402.793996:0:17845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789302402.794009:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789302402.794049:0:17845:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789302402.794083:0:17845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd39a576 00000100:00080000:3.0:1789302402.794093:0:17845:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302402.794104:0:17845:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cc4b5138800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302402.794164:0:17845:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd802d80 x1876219121551744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302402.794180:0:17845:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789302402.794223:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302402.794227:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.794234:0:17845:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789302402.794237:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302402.794241:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.794242:0:17845:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789302402.794245:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789302402.794247:0:17845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789302402.794249:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302402.794251:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.794253:0:17845:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789302402.794255:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302402.794257:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.794258:0:17845:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789302402.794262:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789302402.794286:0:17845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302402.794289:0:17845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302402.794290:0:17845:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789302402.794293:0:17845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:3.0:1789302402.794688:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302402.794693:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302402.794696:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302402.794699:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789302402.794748:0:17841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1789302402.794775:0:17841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789302402.794798:0:17841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348000/0x1ff82925bd39a4f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4ff expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302402.794809:0:17841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348000/0x1ff82925bd39a4f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a4ff expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302402.794817:0:17841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b5eab000 from 1 10000000:01000000:1.0:1789302402.794820:0:17841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789302402.794845:0:17841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302402.794864:0:17841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302402.794876:0:17841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302402.794894:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121551872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789302402.794956:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302402.794986:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4813779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302402.795039:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121551872 00000100:00100000:3.0:1789302402.795046:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121551872 00000100:00100000:0.0:1789302402.795231:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121551488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302402.795235:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789302402.795248:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc483daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+15:17841:x1876219121551872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302402.795261:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302402.795273:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd39a584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a57d expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.795295:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd39a584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a57d expref: 16 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.795313:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd39a584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a57d expref: 16 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.795321:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982800, rc 0) 00000100:00100000:3.0:1789302402.795545:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc483daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+16:17841:x1876219121551872:12345-0@lo:101:mount.lustre.0 Request processed in 299us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302402.795552:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789302402.795636:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121551744:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789302402.795665:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219121551744 offset 0 length 520: 4 00000100:00100000:1.0:1789302402.795821:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121551872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302402.795835:0:17841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302402.795844:0:17841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302402.802939:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552000:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789302402.803014:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.803095:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789302402.803314:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121552000 00000100:00100000:1.0:1789302402.803322:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121552000 00000100:00100000:0.0:1789302402.803588:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789302402.803596:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+16:17841:x1876219121552000:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789302402.803614:0:17104:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789302402.803652:0:17104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789302402.803655:0:17104:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789302402.803742:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+16:17841:x1876219121552000:12345-0@lo:256:mount.lustre.0 Request processed in 145us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.803751:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789302402.803768:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552000:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789302402.804426:0:17841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789302402.804450:0:17841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.804470:0:17841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302402.804479:0:17841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b5eab000 from 1 10000000:01000000:3.0:1789302402.804482:0:17841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789302402.804822:0:17841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.804832:0:17841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.804842:0:17841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302402.804863:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789302402.804916:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302402.805018:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49018c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789302402.805216:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121552128 00000100:00100000:0.0:1789302402.805232:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121552128 00000100:00100000:0.0:1789302402.805304:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789302402.805313:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+16:17841:x1876219121552128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302402.805324:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302402.806081:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48311da00/0x1ff82925bd39a592 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a58b expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.806212:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48311da00/0x1ff82925bd39a592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a58b expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.806241:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48311da00/0x1ff82925bd39a592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a58b expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.806250:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311da00, rc 0) 00000100:00100000:0.0:1789302402.806314:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17841:x1876219121552128:12345-0@lo:101:mount.lustre.0 Request processed in 1003us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.806322:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789302402.806670:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302402.806687:0:17841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.806697:0:17841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302402.806831:0:17841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789302402.806872:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302402.806906:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302402.807155:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48876c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789302402.807210:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121552256 00000100:00100000:0.0:1789302402.807217:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121552256 00000100:00100000:0.0:1789302402.807307:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789302402.807318:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17841:x1876219121552256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302402.807438:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17841:x1876219121552256:12345-0@lo:501:mount.lustre.0 Request processed in 122us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.807445:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789302402.807562:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302402.807593:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789302402.807636:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302402.807884:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48876c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302402.807980:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121552384 00000100:00100000:2.0:1789302402.807985:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121552384 00000100:00100000:2.0:1789302402.808009:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789302402.808016:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17841:x1876219121552384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302402.808135:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17841:x1876219121552384:12345-0@lo:503:mount.lustre.0 Request processed in 94us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302402.808142:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789302402.808273:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552384:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789302402.808612:0:17841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789302402.808688:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302402.808721:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302402.808743:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48876c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302402.810614:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121552512 00000100:00100000:2.0:1789302402.810628:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121552512 00000100:00100000:2.0:1789302402.810674:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789302402.810682:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17841:x1876219121552512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302402.810842:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17841:x1876219121552512:12345-0@lo:502:mount.lustre.0 Request processed in 159us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302402.810850:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789302402.810966:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789302402.811214:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789302402.811258:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1789302402.811284:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1789302402.811298:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1789302402.811311:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1789302402.811323:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1789302402.811333:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1789302402.811344:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1789302402.811356:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789302402.811398:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1789302402.811416:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1789302402.811459:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302402.811504:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302402.811532:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48876c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302402.811792:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121552640 00000100:00100000:2.0:1789302402.811798:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121552640 00000100:00100000:2.0:1789302402.811895:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789302402.811905:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17841:x1876219121552640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302402.812023:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17841:x1876219121552640:12345-0@lo:502:mount.lustre.0 Request processed in 120us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302402.812030:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789302402.812154:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789302402.812239:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1789302402.812269:0:17841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789302402.812964:0:17855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302402.812973:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.812975:0:17855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789302402.812982:0:17855:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc4b5eab000 00000020:00000080:2.0:1789302402.812984:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789302402.812992:0:17855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302402.812995:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.812996:0:17855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789302402.812998:0:17855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302402.813000:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.813001:0:17855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789302402.813004:0:17855:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc4b5eab000 00000020:00000080:2.0:1789302402.813006:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789302402.813058:0:17855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302402.813061:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.813063:0:17855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789302402.813065:0:17855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302402.813068:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.813069:0:17855:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789302402.813072:0:17855:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc4b5eab000 00000020:00000080:2.0:1789302402.813074:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789302402.813092:0:17855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302402.813095:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.813096:0:17855:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789302402.813098:0:17855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302402.813106:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.813107:0:17855:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789302402.813134:0:17855:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc4b5eab000 00000020:00000080:2.0:1789302402.813136:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789302402.813160:0:17855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302402.813162:0:17855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302402.813164:0:17855:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789302402.813166:0:17855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1789302402.813369:0:17841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789302402.813401:0:17841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789302402.813417:0:17841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.813437:0:17841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302402.813481:0:17841:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789302402.813484:0:17841:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cc4b5eab000 10000000:01000000:3.0:1789302402.813487:0:17841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cc4b5eab000 10000000:01000000:3.0:1789302402.813491:0:17841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789302402.813497:0:17841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc4b5eab000 from 1 10000000:01000000:3.0:1789302402.813500:0:17841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789302402.813529:0:17841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd39a599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.813542:0:17841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd39a599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.813553:0:17841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd39a599 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302402.813573:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789302402.813620:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302402.813658:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48876c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789302402.813766:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121552768 00000100:00100000:2.0:1789302402.813773:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121552768 00000100:00100000:2.0:1789302402.813805:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789302402.813812:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17841:x1876219121552768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302402.813824:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302402.813837:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd39a5a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a599 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.813859:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd39a5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a599 expref: 18 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.813870:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5349000/0x1ff82925bd39a5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a599 expref: 18 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.813879:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349000, rc 0) 00000100:00100000:2.0:1789302402.813922:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121552768:12345-0@lo:101:mount.lustre.0 Request processed in 110us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302402.813929:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789302402.814044:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302402.814058:0:17841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd39a599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5a0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302402.814067:0:17841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd39a599 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a5a0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789302402.834200:0:17841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789302402.834522:0:17841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302402.834753:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789302402.834780:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789302402.834793:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789302402.834805:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789302402.834819:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789302402.834831:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789302402.834843:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789302402.834856:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789302402.834869:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789302402.834882:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789302402.834894:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789302402.834906:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789302402.834929:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789302402.834942:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789302402.834953:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789302402.834966:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789302402.834992:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789302402.835008:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789302402.835019:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789302402.835031:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789302402.835044:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789302402.835065:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789302402.835076:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789302402.835089:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789302402.835101:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789302402.835140:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789302402.835157:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789302402.835171:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789302402.835188:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789302402.835195:0:17841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789302402.835270:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302402.835331:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.835374:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302402.835440:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121552896 00000100:00100000:0.0:1789302402.835446:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121552896 00000100:00100000:0.0:1789302402.835494:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789302402.835503:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121552896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302402.835603:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121552896:12345-0@lo:501:mount.lustre.0 Request processed in 101us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.835611:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789302402.835656:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121552896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302402.835690:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121553024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789302402.835723:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.835737:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302402.835750:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121553024 00000100:00100000:0.0:1789302402.835753:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121553024 00000100:00100000:0.0:1789302402.835775:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789302402.835780:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121553024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789302402.835865:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121553024:12345-0@lo:503:mount.lustre.0 Request processed in 84us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.835872:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789302402.835910:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121553024:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789302402.836244:0:17841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789302402.836293:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121553152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789302402.836327:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.836343:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302402.836359:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121553152 00000100:00100000:0.0:1789302402.836363:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121553152 00000100:00100000:0.0:1789302402.836408:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789302402.836416:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121553152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789302402.836491:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121553152:12345-0@lo:502:mount.lustre.0 Request processed in 76us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.836498:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789302402.836537:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121553152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789302402.836861:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789302402.836885:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1789302402.836910:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1789302402.836924:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1789302402.836937:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1789302402.836949:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1789302402.836962:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1789302402.836974:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1789302402.836987:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1789302402.837000:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1789302402.837011:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1789302402.837023:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1789302402.839362:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1789302402.839406:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1789302402.839421:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1789302402.839435:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1789302402.839450:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1789302402.839480:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1789302402.839495:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1789302402.839508:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1789302402.839521:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1789302402.839532:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1789302402.839544:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1789302402.839557:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1789302402.839569:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1789302402.839582:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1789302402.839595:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1789302402.839606:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1789302402.839619:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1789302402.839631:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1789302402.839642:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1789302402.839655:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1789302402.839666:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1789302402.839693:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1789302402.839707:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1789302402.839729:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1789302402.839742:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1789302402.839754:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1789302402.839766:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1789302402.839779:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1789302402.839791:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1789302402.839803:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1789302402.839815:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1789302402.839829:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1789302402.839841:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1789302402.839853:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1789302402.839865:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1789302402.843453:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1789302402.843587:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121553280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789302402.843674:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.843734:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33540 going to sleep for 11 seconds 00000100:00100000:1.0:1789302402.843742:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121553280 00000100:00100000:1.0:1789302402.843750:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121553280 00000100:00100000:1.0:1789302402.843806:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789302402.843826:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121553280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302402.844105:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121553280:12345-0@lo:502:mount.lustre.0 Request processed in 281us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302402.844130:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789302402.844598:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121553280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789302402.844787:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1789302402.844812:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1789302402.844840:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121553408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789302402.844883:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.844920:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a33540 going to sleep for 11 seconds 00000100:00100000:1.0:1789302402.845462:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121553408 00000100:00100000:1.0:1789302402.845469:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121553408 00000100:00100000:1.0:1789302402.845518:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789302402.845527:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121553408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302402.845618:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121553408:12345-0@lo:502:mount.lustre.0 Request processed in 92us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302402.845625:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789302402.845706:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121553408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789302402.845753:0:17841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1789302402.845762:0:17841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789302402.846502:0:17859:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789302402.846517:0:17859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8cc4b50bcd40) 00000020:00000080:0.0:1789302402.846538:0:17859:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789302402.846612:0:17859:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc4b5eab000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789302402.846622:0:17859:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc4b5eab000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789302402.846624:0:17859:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc4b5eab000 3 00010000:00080000:0.0:1789302402.846653:0:17859:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc4b5ece000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.109@tcp at head 00010000:00010000:0.0:1789302402.857837:0:17859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789302402.863080:0:17859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789302402.863151:0:17859:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789302402.863167:0:17859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x1ff82925bd39a5ae 00000100:00080000:0.0:1789302402.863179:0:17859:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789302402.863191:0:17859:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cc4b5ece000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302402.867325:0:17859:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc485d52a00 x1876219121553536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302402.867366:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876219121553536:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789302402.868022:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789302402.868086:0:17859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789302402.868109:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302402.868135:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789302402.868138:0:13920:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302402.868141:0:13920:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789302402.869573:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121553536 00000100:00100000:2.0:1789302402.869586:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121553536 00000100:00100000:2.0:1789302402.869632:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302402.869640:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876219121553536:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789302402.869682:0:17110:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1789302402.869733:0:17110:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x1ff82925bd39a5b5 00000004:00100000:2.0:1789302402.869749:0:17110:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789302402.869784:0:17110:0:(import.c:65:import_set_state_nolock()) ffff8cc485d49800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302402.869863:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876219121553536:12345-0@lo:38:llog_process_th.0 Request processed in 221us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302402.869871:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789302402.869966:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cc485d52a00 x1876219121553536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302402.869978:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789302402.869987:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789302402.869994:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789302402.869999:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789302402.870001:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5ece000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789302402.870014:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876219121553536:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789302402.870150:0:17859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1789302402.875034:0:17841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789302402.875077:0:17841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789302402.875100:0:17841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd39a599 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5a0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302402.875141:0:17841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983c00/0x1ff82925bd39a599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5a0 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789302402.875195:0:17841:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789302402.875198:0:17841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789302402.875199:0:17841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302402.875200:0:17841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302402.875201:0:17841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302402.875202:0:17841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302402.875203:0:17841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789302402.875205:0:17841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302402.875206:0:17841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789302402.875210:0:17841:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789302402.875213:0:17841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789302402.875214:0:17841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789302402.875215:0:17841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302402.875216:0:17841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302402.875217:0:17841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302402.875218:0:17841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302402.875219:0:17841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789302402.875220:0:17841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302402.875221:0:17841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789302402.875245:0:17841:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789302402.875267:0:17841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121553664:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789302402.875338:0:17841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302402.875372:0:17841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7ef6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302402.875504:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121553664 00000100:00100000:0.0:1789302402.875513:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121553664 00000100:00100000:0.0:1789302402.875561:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302402.875570:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121553664:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789302402.875596:0:17102:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789302402.875610:0:17102:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789302402.879598:0:17090:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789302402.879672:0:17102:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789302402.879690:0:17102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789302402.879784:0:17126:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789302402.879789:0:17126:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789302402.879810:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.879828:0:17126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a4c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a4b9 expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.879835:0:17126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd39a584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a57d expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.879842:0:17126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.879880:0:17126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd39a584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a57d expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.879893:0:17126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd39a584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a57d expref: 18 pid: 17105 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302402.879908:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121553792:0@lo:104: 00000100:00100000:2.0:1789302402.879971:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302402.880038:0:17126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a4c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a4b9 expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.880047:0:17126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a4c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a4b9 expref: 18 pid: 17105 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302402.880055:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121553920:0@lo:104: 00000100:00100000:2.0:1789302402.880083:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302402.880106:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fc180 going to sleep for 11 seconds 00000100:00100000:0.0:1789302402.880307:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121553792 00000100:00100000:0.0:1789302402.880314:0:17094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121553792 00000100:00100000:0.0:1789302402.880344:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121553920 00000100:00100000:0.0:1789302402.880347:0:17094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121553920 00000100:00100000:0.0:1789302402.880359:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302402.880367:0:17094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+4:17126:x1876219121553792:12345-0@lo:104: 00010000:00010000:0.0:1789302402.880379:0:17094:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880444:0:17094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302402.880450:0:17094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+4:17126:x1876219121553792:12345-0@lo:104: Request processed in 84us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.880456:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302402.880471:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789302402.880477:0:17094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:17126:x1876219121553920:12345-0@lo:104: 00010000:00010000:0.0:1789302402.880485:0:17094:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880514:0:17094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789302402.880526:0:17094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:17126:x1876219121553920:12345-0@lo:104: Request processed in 49us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.880532:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789302402.880547:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789302402.880553:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880560:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aba00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:0.0:1789302402.880564:0:17098:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880572:0:17098:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302402.880579:0:17098:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302402.880585:0:17098:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789302402.880611:0:17098:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880618:0:17098:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302402.880637:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880645:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a57d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a584 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880656:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302402.880659:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880674:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982e00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:0.0:1789302402.880678:0:17098:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880684:0:17098:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302402.880690:0:17098:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302402.880695:0:17098:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789302402.880709:0:17098:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880715:0:17098:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302402.880720:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880726:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a4b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a4c0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880738:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302402.880740:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302402.880742:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302402.880749:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302402.880766:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121554048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302402.880793:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.880813:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302402.880818:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121554176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302402.880844:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.880882:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121554048 00000100:00100000:0.0:1789302402.880887:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121554048 00010000:00010000:0.0:1789302402.880903:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd39a584 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a57d expref: 19 pid: 17105 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302402.880921:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121554176 00000100:00100000:0.0:1789302402.880925:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121554176 00010000:00010000:0.0:1789302402.880934:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a4c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a4b9 expref: 20 pid: 17105 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302402.880945:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302402.880950:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:3645:x1876219121554048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302402.880960:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302402.880964:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd39a584 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a57d expref: 20 pid: 17105 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880973:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd39a584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a57d expref: 20 pid: 17105 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.880987:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302402.881013:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:3645:x1876219121554048:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.881019:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302402.881031:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789302402.881038:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:3645:x1876219121554176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302402.881058:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302402.881062:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a4c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a4b9 expref: 19 pid: 17105 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.881092:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a4c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a4b9 expref: 19 pid: 17105 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.881103:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.881131:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789302402.881144:0:17096:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004768244s 00010000:00010000:0.0:1789302402.881149:0:17096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.881155:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.881162:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.881168:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.881174:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302402.881179:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.881186:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.881194:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302402.881209:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302402.881231:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:3645:x1876219121554176:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.881238:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789302402.881274:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121554176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302402.881282:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121554048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302402.884849:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17841:x1876219121553664:12345-0@lo:253:mount.lustre.0 Request processed in 9272us (9502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.884863:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789302402.885045:0:17841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:17841:1876219121553664:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789302402.885061:0:17841:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789302402.885075:0:17841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789302402.885076:0:17841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789302402.885078:0:17841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302402.885080:0:17841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302402.885081:0:17841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302402.885082:0:17841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302402.885084:0:17841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789302402.885085:0:17841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302402.885086:0:17841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789302402.885100:0:17841:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789302402.886285:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa982800/0x1ff82925bd39a584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a57d expref: 17 pid: 17105 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302402.886303:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121553792:0@lo:104: 00010000:00010000:2.0:1789302402.886318:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a4c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a4b9 expref: 16 pid: 17105 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302402.886327:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121553920:0@lo:104: 00010000:00010000:2.0:1789302402.886345:0:17126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.886355:0:17126:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.886362:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302402.886369:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a5bc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1789302402.893760:0:17841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789302402.893891:0:17866:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789302402.893895:0:17866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789302402.894062:0:17867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1789302402.894458:0:17867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302402.897132:0:17867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789302402.897203:0:17867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1789302402.897577:0:17841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789302402.898021:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17869:1876219121554304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789302402.898098:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.898161:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852cde40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302402.898507:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121554304 00000100:00100000:2.0:1789302402.898523:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121554304 00000100:00100000:2.0:1789302402.901169:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302402.901455:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17869:x1876219121554304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789302402.901569:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17869:x1876219121554304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 389us (3471us total) trans 0 rc 0/0 00000040:01000000:1.0:1789302402.903176:0:17841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789302402.903233:0:17841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789302402.903662:0:17841:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789302402.903670:0:17841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789302402.903705:0:17841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789302402.908229:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1789302402.908230:0:17841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789302402.911222:0:17841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789302402.911313:0:17841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789302402.911449:0:17841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789302402.911957:0:17841:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:0.0:1789302402.913041:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17869:1876219121554304:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789302402.913163:0:17869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000001:00000004:1.0:1789302402.916631:0:17841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789302402.916844:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17869:1876219121554432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789302402.916917:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.916947:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852cd600 going to sleep for 11 seconds 00000100:00100000:3.0:1789302402.917017:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121554432 00000100:00100000:3.0:1789302402.917026:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121554432 00000100:00100000:3.0:1789302402.917080:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789302402.917088:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17869:x1876219121554432:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789302402.917236:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17869:x1876219121554432:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 133us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302402.917244:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302402.917406:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17869:1876219121554432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789302402.917470:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17869:1876219121554560:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789302402.917505:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.917523:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1789302402.918365:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121554560 00000100:00100000:3.0:1789302402.918377:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121554560 00000100:00100000:3.0:1789302402.918425:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302402.918433:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17869:x1876219121554560:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789302402.918486:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17869:x1876219121554560:12345-0@lo:900:lod0001_rec0000.0 Request processed in 54us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302402.918493:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789302402.918621:0:17869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cc485d52a00 x1876219121554560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789302418 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302402.918633:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17869:1876219121554560:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789302402.918685:0:17869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17869:1876219121554688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789302402.918715:0:17869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302402.918733:0:17869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4852cd600 going to sleep for 11 seconds 00000100:00100000:0.0:1789302402.919346:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121554688 00000100:00100000:0.0:1789302402.919352:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121554688 00000100:00100000:0.0:1789302402.919395:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789302402.919403:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17869:x1876219121554688:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789302402.919472:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17869:x1876219121554688:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 69us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302402.919479:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789302402.919514:0:17869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17869:1876219121554688:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789302402.919562:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302402.922923:0:17869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789302402.922996:0:17869:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789302402.923001:0:17869:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1789302402.931156:0:17841:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789302402.931198:0:17841:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffadc441d07988 00100000:10000000:1.0:1789302402.931206:0:17841:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789302402.931841:0:17841:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789302402.931870:0:17841:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789302402.931889:0:17841:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789302402.931904:0:17841:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789302402.933943:0:17841:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302402.941700:0:17841:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789302403.095211:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:0.0:1789302403.606152:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302403.925108:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789302403.988451:0:17107:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789302403.988459:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b5eab000 from 8 10000000:01000000:0.0:1789302403.988464:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789302403.988512:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302403.988525:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302403.988537:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302403.988564:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121554816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302403.988630:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302403.988687:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc483b37d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302403.988747:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121554816 00000100:00100000:1.0:1789302403.988764:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121554816 00000100:00100000:1.0:1789302403.988819:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789302403.988829:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+16:17107:x1876219121554816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302403.988842:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302403.988855:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc3839ab200/0x1ff82925bd39a5ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a5c3 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302403.988877:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc3839ab200/0x1ff82925bd39a5ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a5c3 expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302403.988886:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc3839ab200/0x1ff82925bd39a5ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a5c3 expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302403.988893:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839ab200, rc 0) 00000100:00100000:1.0:1789302403.988939:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17107:x1876219121554816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302403.988953:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789302403.989081:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121554816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302403.989096:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302403.989105:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302403.989182:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121554944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789302403.989214:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302403.989228:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302403.989281:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121554944 00000100:00100000:0.0:1789302403.989286:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121554944 00000100:00100000:0.0:1789302403.989354:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789302403.989362:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17107:x1876219121554944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789302403.989376:0:17104:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789302403.989402:0:17104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789302403.989405:0:17104:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789302403.989481:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17107:x1876219121554944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302403.989489:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789302403.989618:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121554944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789302403.989663:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789302403.989670:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302403.989678:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302403.989687:0:17107:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789302403.989689:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc38422d000 from 8 10000000:01000000:3.0:1789302403.989697:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789302403.989715:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302403.989723:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302403.989731:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302403.989743:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121555072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789302403.989769:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302403.989799:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a339c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302403.989964:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121555072 00000100:00100000:1.0:1789302403.989969:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121555072 00000100:00100000:1.0:1789302403.990002:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789302403.990009:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17107:x1876219121555072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302403.990017:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302403.990026:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc3839aa400/0x1ff82925bd39a5d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a5d1 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302403.990042:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc3839aa400/0x1ff82925bd39a5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a5d1 expref: 18 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302403.990051:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc3839aa400/0x1ff82925bd39a5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a5d1 expref: 18 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302403.990066:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aa400, rc 0) 00000100:00100000:1.0:1789302403.990097:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17107:x1876219121555072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302403.990103:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789302403.990213:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121555072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302403.990224:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302403.990232:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302403.990271:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121555200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789302403.990313:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302403.990332:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a339c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302403.990533:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121555200 00000100:00100000:1.0:1789302403.990538:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121555200 00000100:00100000:1.0:1789302403.990570:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789302403.990576:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17107:x1876219121555200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789302403.990587:0:17102:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789302403.990600:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789302403.990603:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789302403.990670:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17107:x1876219121555200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302403.990677:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789302403.990811:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121555200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789302403.990847:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789302403.990853:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302403.990869:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302404.118735:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:0.0:1789302404.628385:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302404.949694:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789302405.140801:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:0.0:1789302405.653655:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302406.165401:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:1.0:1789302406.676469:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302407.188182:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00010000:00010000:0.0:1789302407.700434:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789302407.821383:0:18111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789302408.213968:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 0 seconds 00000100:00080000:0.0:1789302408.276630:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789302408.276636:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789302408.276640:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc491235800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302408.276655:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cc491235800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302408.276677:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc485d52300 x1876219121555456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789302408.276694:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302408.276697:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789302408.276700:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302408.276703:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789302408.276726:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302408.276730:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789302408.276732:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302408.276735:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789302408.276760:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121555328:0@lo:400:kworker.0 00000100:00100000:0.0:1789302408.276826:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302408.276882:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302408.276889:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121555584:0@lo:400:kworker.0 00000100:00100000:0.0:1789302408.276914:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302408.276945:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121555456:0@lo:38:kworker.0 00000100:00100000:0.0:1789302408.276970:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302408.276997:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121555712:0@lo:400:kworker.0 00000100:00100000:0.0:1789302408.277062:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302408.277092:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302408.277098:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121555840:0@lo:400:kworker.0 00000100:00100000:0.0:1789302408.277141:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302408.277184:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121555456 00000100:00100000:0.0:1789302408.277191:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121555456 00000100:00100000:0.0:1789302408.277221:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121555712 00000100:00100000:0.0:1789302408.277224:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121555712 00000100:00100000:0.0:1789302408.277311:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789302408.277320:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876219121555456:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789302408.277363:0:17115:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1789302408.277409:0:17115:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd39a5df 00000004:00100000:0.0:1789302408.277424:0:17115:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789302408.277429:0:17115:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789302408.277499:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302408.277507:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121555712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302408.277555:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121555712:12345-0@lo:400:kworker.0 Request processed in 50us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302408.277562:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302408.277601:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121555712:0@lo:400:kworker.0 00000100:00100000:2.0:1789302408.277757:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121555584 00000100:00100000:2.0:1789302408.277762:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121555584 00000100:00100000:2.0:1789302408.277794:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121555840 00000100:00100000:2.0:1789302408.277798:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121555840 00000100:00100000:2.0:1789302408.277812:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302408.277819:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121555584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302408.277858:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121555584:12345-0@lo:400:kworker.0 Request processed in 39us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302408.277864:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302408.277875:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789302408.277881:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121555840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302408.277911:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121555840:12345-0@lo:400:kworker.0 Request processed in 30us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302408.277917:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789302408.277946:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc485d53b80 x1876219121555584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302408.277956:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121555584:0@lo:400:kworker.0 00010000:00080000:2.0:1789302408.277981:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc484fe1180 x1876219121555840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302408.278002:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121555840:0@lo:400:kworker.0 00000100:00100000:1.0:1789302408.278074:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121555328 00000100:00100000:1.0:1789302408.278078:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121555328 00000100:00100000:1.0:1789302408.278132:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789302408.278140:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:3647:x1876219121555328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302408.278184:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:3647:x1876219121555328:12345-0@lo:400:kworker.0 Request processed in 45us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302408.278190:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789302408.278225:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121555328:0@lo:400:kworker.0 00000100:00100000:3.0:1789302408.278545:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302408.278556:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121555968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302408.278586:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302408.278613:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121555968 00000100:00100000:3.0:1789302408.278617:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121555968 00000100:00100000:3.0:1789302408.278642:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789302408.278647:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121555968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789302408.278671:0:17116:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789302408.278707:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121555968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302408.278713:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789302408.278790:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121555968:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789302408.287152:0:17115:0:(import.c:65:import_set_state_nolock()) ffff8cc487de0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302408.287372:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876219121555456:12345-0@lo:38:kworker.0 Request processed in 10049us (10398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302408.287383:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789302408.290958:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789302408.290973:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789302408.290980:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789302408.290984:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc491235800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789302408.291001:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000059281d09): req@ffff8cc3843ee680 x1876219121548544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302408.291022:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121555456:0@lo:38:kworker.0 00000100:00100000:3.0:1789302408.291827:0:17151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302408.291864:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc485ddc240 going to sleep for 11 seconds 00000100:00100000:1.0:1789302408.291923:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121548544 00000100:00100000:1.0:1789302408.291930:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121548544 00000100:00100000:1.0:1789302408.291987:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302408.291996:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17151:x1876219121548544:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789302408.292096:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17151:x1876219121548544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 101us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302408.292104:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789302408.292436:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17151:1876219121548544:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1789302408.292472:0:17151:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789302408.292513:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17151:1876219121556096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789302408.292549:0:17151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302408.292575:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302408.292953:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302408.292963:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121556224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302408.292991:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302408.293028:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121556096 00000100:00100000:0.0:1789302408.293033:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121556096 00000100:00100000:0.0:1789302408.293052:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121556224 00000100:00100000:0.0:1789302408.293056:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121556224 00000100:00100000:0.0:1789302408.293067:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302408.293073:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17151:x1876219121556096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789302408.293531:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789302408.293539:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121556224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789302408.293559:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789302408.293593:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121556224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302408.293600:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302408.293644:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17151:x1876219121556096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 570us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302408.293660:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302408.293694:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121556224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302408.293987:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17151:1876219121556096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789302408.294057:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17151:1876219121556352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789302408.294421:0:17151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302408.294474:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302408.294509:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121556352 00000100:00100000:1.0:1789302408.294515:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121556352 00000100:00100000:1.0:1789302408.294585:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789302408.294594:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17151:x1876219121556352:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789302408.294667:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17151:x1876219121556352:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302408.294674:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789302408.294722:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17151:1876219121556352:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789302408.294766:0:17151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302408.296922:0:17151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789302408.297000:0:17151:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1789302408.297005:0:17151:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789302408.726565:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789302408.770357:0:18164:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302408.770611:0:18164:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1789302409.735629:0:18214:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789302409.735846:0:18214:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789302409.758927:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789302410.197001:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789302410.776420:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789302411.018914:0:18262:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcf060a10 20000000:00000080:3.0:1789302411.018950:0:18262:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cc4bd325000 uarg=0000000000000000 20000000:01000000:3.0:1789302411.019002:0:18262:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789302411.020261:0:18262:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789302411.020287:0:18262:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789302411.021425:0:18263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789302411.021970:0:18262:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789302411.041621:0:18262:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789302411.041761:0:18262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302411.041785:0:18262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a48f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a488 expref: 17 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302411.041792:0:18262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48311da00/0x1ff82925bd39a592 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a58b expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302411.041800:0:18262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302411.041855:0:18262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48311da00/0x1ff82925bd39a592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a58b expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302411.041875:0:18262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc48311da00/0x1ff82925bd39a592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a58b expref: 17 pid: 17105 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302411.041917:0:18262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18262:1876219121556480:0@lo:104: 00000100:00100000:0.0:1789302411.042029:0:18262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302411.042098:0:18262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a48f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a488 expref: 17 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302411.042107:0:18262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a48f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a488 expref: 17 pid: 17102 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302411.042147:0:18262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18262:1876219121556608:0@lo:104: 00000100:00100000:0.0:1789302411.042168:0:18262:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302411.042186:0:18262:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc486159d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302411.042305:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121556480 00000100:00100000:3.0:1789302411.042317:0:17094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121556480 00000100:00100000:3.0:1789302411.042385:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121556608 00000100:00100000:3.0:1789302411.042389:0:17094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121556608 00000100:00100000:3.0:1789302411.042406:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302411.042415:0:17094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+4:18262:x1876219121556480:12345-0@lo:104: 00010000:00010000:3.0:1789302411.042432:0:17094:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042492:0:17094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302411.042499:0:17094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+4:18262:x1876219121556480:12345-0@lo:104: Request processed in 85us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302411.042506:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302411.042529:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302411.042535:0:17094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:18262:x1876219121556608:12345-0@lo:104: 00010000:00010000:3.0:1789302411.042544:0:17094:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042579:0:17094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789302411.042584:0:17094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:18262:x1876219121556608:12345-0@lo:104: Request processed in 50us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302411.042590:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789302411.042607:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302411.042614:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042633:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982000 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302411.042638:0:17099:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042647:0:17099:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302411.042654:0:17099:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302411.042661:0:17099:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789302411.042694:0:17099:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042701:0:17099:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302411.042724:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042731:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982000/0x1ff82925bd39a58b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a592 expref: -99 pid: 17841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042748:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302411.042751:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042757:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa600 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:3.0:1789302411.042759:0:17099:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042778:0:17099:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302411.042785:0:17099:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302411.042790:0:17099:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789302411.042805:0:17099:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042811:0:17099:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302411.042818:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042824:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a488 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a48f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.042840:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302411.042841:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302411.042843:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302411.042867:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121556864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302411.042900:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302411.042927:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302411.042941:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121556736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302411.042963:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302411.042990:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121556864 00000100:00100000:3.0:1789302411.042994:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121556864 00010000:00010000:3.0:1789302411.043018:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a48f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a488 expref: 18 pid: 17102 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302411.043052:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121556736 00000100:00100000:3.0:1789302411.043055:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121556736 00010000:00010000:3.0:1789302411.043066:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48311da00/0x1ff82925bd39a592 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a58b expref: 19 pid: 17105 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302411.043076:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302411.043081:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:3646:x1876219121556864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302411.043093:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302411.043099:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a48f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a488 expref: 19 pid: 17102 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043107:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a48f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a488 expref: 19 pid: 17102 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043153:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302411.043181:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:3646:x1876219121556864:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302411.043187:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302411.043201:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302411.043206:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:3646:x1876219121556736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302411.043213:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302411.043216:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48311da00/0x1ff82925bd39a592 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a58b expref: 18 pid: 17105 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043224:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48311da00/0x1ff82925bd39a592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a58b expref: 18 pid: 17105 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043236:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043252:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043278:0:17095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043286:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043292:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043299:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043303:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311c800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302411.043308:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043315:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043324:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.043344:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302411.043368:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:3646:x1876219121556736:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302411.043375:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302411.043419:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121556736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302411.043436:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121556864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302411.043882:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302411.044465:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48311da00/0x1ff82925bd39a592 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a58b expref: 17 pid: 17105 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302411.044485:0:18262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18262:1876219121556480:0@lo:104: 00010000:00010000:0.0:1789302411.044497:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a48f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a488 expref: 16 pid: 17102 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302411.044606:0:18262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18262:1876219121556608:0@lo:104: 00010000:00010000:0.0:1789302411.044636:0:18262:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302411.044646:0:18262:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302411.044653:0:18262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302411.044679:0:18262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48311c800/0x1ff82925bd39a5e6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302411.801928:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789302412.251017:0:17107:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789302412.251027:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b5eab000 from 13 10000000:01000000:0.0:1789302412.251034:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302412.251094:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302412.251108:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302412.251216:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302412.251247:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121556992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302412.251349:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302412.251438:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc486159480 going to sleep for 11 seconds 00000100:00100000:3.0:1789302412.254017:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121556992 00000100:00100000:3.0:1789302412.254038:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121556992 00000100:00100000:3.0:1789302412.254259:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789302412.254272:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+16:17107:x1876219121556992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302412.254293:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302412.254330:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd39a5f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a5ed expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302412.254368:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd39a5f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a5ed expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302412.254382:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd39a5f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a5ed expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302412.254691:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982000, rc 0) 00000100:00100000:3.0:1789302412.254804:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17107:x1876219121556992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 534us (3455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302412.254813:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789302412.254936:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121556992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302412.254961:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302412.254973:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302412.255080:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121557120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302412.255141:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302412.259632:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc486159480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302412.260060:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121557120 00000100:00100000:1.0:1789302412.260073:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121557120 00000100:00100000:1.0:1789302412.260161:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789302412.260172:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17107:x1876219121557120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302412.260434:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17107:x1876219121557120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (5293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302412.260443:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789302412.261195:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121557120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302412.261275:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121557248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302412.261354:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302412.261380:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc486159480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302412.262923:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121557248 00000100:00100000:1.0:1789302412.262941:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121557248 00000100:00100000:1.0:1789302412.263015:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789302412.263027:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17107:x1876219121557248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302412.263260:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17107:x1876219121557248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302412.263269:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789302412.263549:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121557248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789302412.264612:0:18313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789302412.265040:0:17107:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789302412.265072:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302412.265085:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302412.265099:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302412.265137:0:17107:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302412.265141:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc38422d000 from 13 10000000:01000000:1.0:1789302412.265145:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302412.265196:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302412.265205:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302412.265219:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302412.265278:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121557376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302412.265368:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302412.265559:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302412.265826:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121557376 00000100:00100000:3.0:1789302412.265835:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121557376 00000100:00100000:0.0:1789302412.269680:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789302412.269697:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+17:17107:x1876219121557376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302412.269720:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302412.269747:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48311d200/0x1ff82925bd39a602 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a5fb expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302412.269783:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48311d200/0x1ff82925bd39a602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a5fb expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302412.269796:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48311d200/0x1ff82925bd39a602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a5fb expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302412.269806:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311d200, rc 0) 00000100:00100000:0.0:1789302412.269903:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17107:x1876219121557376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (4534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302412.269910:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789302412.270423:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121557376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302412.270449:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302412.270461:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302412.270562:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121557504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302412.270608:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302412.270642:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302412.270883:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121557504 00000100:00100000:0.0:1789302412.270890:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121557504 00000100:00100000:0.0:1789302412.270927:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789302412.270936:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17107:x1876219121557504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302412.274945:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17107:x1876219121557504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3996us (4322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302412.274963:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789302412.275438:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121557504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302412.275511:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121557632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302412.275579:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302412.275626:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302412.275761:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121557632 00000100:00100000:0.0:1789302412.275769:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121557632 00000100:00100000:0.0:1789302412.275829:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789302412.275839:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17107:x1876219121557632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302412.275963:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:17107:x1876219121557632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302412.275970:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789302412.276580:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121557632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789302412.277612:0:18315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789302412.277887:0:17107:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789302412.277913:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302412.277926:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302412.277941:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302412.373257:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302402/real 1789302402] req@ffff8cc4bd802d80 x1876219121551744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302412 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302412.373306:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc4bd802d80 x1876219121551744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302412 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302412.373327:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302402/real 1789302402] req@ffff8cc4bd802680 x1876219121551616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302412 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302412.373339:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc4bd802680 x1876219121551616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302412 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789302412.373363:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302412.373385:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789302412.373390:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121551744:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789302412.373397:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5208000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302412.373401:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789302412.373404:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121551616:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789302412.373674:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302412.373679:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789302412.373683:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302412.373686:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789302412.373720:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302412.373724:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789302412.373727:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5208000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302412.373733:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 478 00000100:00080000:1.0:1789302412.373740:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789302412.373754:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cc4b5208000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302412.373777:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc3843ee680 x1876219121558144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302412.373789:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302412.373791:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789302412.373793:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302412.373796:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 478 00000100:00080000:1.0:1789302412.373799:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789302412.373803:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cc4b5138800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302412.373815:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc3843ed880 x1876219121558272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789302412.373920:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121558400:0@lo:400:kworker.0 00000100:00100000:3.0:1789302412.374015:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302412.374062:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302412.374068:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121558016:0@lo:400:kworker.0 00000100:00100000:3.0:1789302412.374097:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302412.374160:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121558016 00000100:00100000:3.0:1789302412.374169:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121558016 00000100:00100000:3.0:1789302412.374221:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789302412.374241:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121558016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302412.374299:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121558016:12345-0@lo:400:kworker.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302412.374308:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789302412.374359:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121558016:0@lo:400:kworker.0 00000100:00100000:1.0:1789302412.374545:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121558400 00000100:00100000:1.0:1789302412.374550:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121558400 00000100:00100000:1.0:1789302412.374589:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789302412.374595:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121558400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302412.374636:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121558400:12345-0@lo:400:kworker.0 Request processed in 41us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302412.374643:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789302412.374676:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc3843ef480 x1876219121558400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302412.374700:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121558400:0@lo:400:kworker.0 00000100:00100000:2.0:1789302412.374821:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121557760:0@lo:400:kworker.0 00000100:00100000:2.0:1789302412.374858:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302412.374879:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302412.374885:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121557888:0@lo:400:kworker.0 00000100:00100000:2.0:1789302412.374905:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302412.374939:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121557888 00000100:00100000:2.0:1789302412.374943:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121557888 00000100:00100000:2.0:1789302412.374965:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302412.374971:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121557888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302412.375021:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121557888:12345-0@lo:400:kworker.0 Request processed in 49us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302412.375038:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789302412.375066:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc3843eed80 x1876219121557888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302412.375075:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121557888:0@lo:400:kworker.0 00000100:00100000:2.0:1789302412.375094:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121558144:0@lo:8:kworker.0 00000400:00000100:2.0:1789302412.375135:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219121558144 offset 0 length 520: 4 00000100:00100000:2.0:1789302412.375157:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121558272:0@lo:8:kworker.0 00000400:00000100:2.0:1789302412.375171:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219121558272 offset 0 length 520: 4 00000100:00100000:1.0:1789302412.375347:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121557760 00000100:00100000:1.0:1789302412.375351:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121557760 00000100:00100000:1.0:1789302412.375386:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789302412.375393:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121557760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302412.375428:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121557760:12345-0@lo:400:kworker.0 Request processed in 36us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302412.375435:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789302412.375749:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121557760:0@lo:400:kworker.0 00010000:00010000:1.0:1789302412.820587:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302413.396255:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302398/real 1789302398] req@ffff8cc485d53480 x1876219121549568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302413 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302413.396287:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc485d53480 x1876219121549568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302413 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302413.396298:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302398/real 1789302398] req@ffff8cc485d53800 x1876219121549696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302413 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302413.396311:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc485d53800 x1876219121549696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302413 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789302413.396340:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4a04cd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302413.396363:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789302413.396368:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121549568:0@lo:8:kworker.0 00000100:00080000:2.0:1789302413.396373:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc486746000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302413.396387:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789302413.396391:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121549696:0@lo:8:kworker.0 00000100:00100000:2.0:1789302413.396673:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121558528:0@lo:400:kworker.0 00000100:00100000:2.0:1789302413.396736:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302413.396925:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121558528 00000100:00100000:3.0:1789302413.396934:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121558528 00000100:00100000:3.0:1789302413.396985:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789302413.396994:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adf5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:3647:x1876219121558528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302413.397627:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adf5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:3647:x1876219121558528:12345-0@lo:400:kworker.0 Request processed in 632us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302413.397637:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789302413.400724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302413.400732:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789302413.400735:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc4a04cd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302413.400743:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:1.0:1789302413.400749:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789302413.400762:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cc4a04cd000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302413.400796:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc3843ef800 x1876219121558912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302413.400825:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302413.400829:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789302413.400831:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc486746000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302413.400835:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:1.0:1789302413.400837:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789302413.400842:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cc486746000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302413.400855:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc3843ec380 x1876219121559040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302413.400898:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302413.400901:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789302413.400905:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302413.400908:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789302413.400950:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121559168:0@lo:400:kworker.0 00000100:00100000:1.0:1789302413.401013:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302413.401058:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789302413.401065:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121558784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302413.401093:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302413.401133:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121559424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302413.401161:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302413.402344:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121558784 00000100:00100000:1.0:1789302413.402356:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121558784 00000100:00100000:1.0:1789302413.402401:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121559424 00000100:00100000:1.0:1789302413.402405:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121559424 00000100:00100000:1.0:1789302413.402425:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789302413.402435:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876219121558784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789302413.402472:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789302413.402800:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121558528:0@lo:400:kworker.0 00000100:00100000:2.0:1789302413.402834:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121559168 00000100:00100000:2.0:1789302413.402839:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121559168 00000100:00100000:2.0:1789302413.402870:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302413.402877:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121559168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302413.403129:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876219121558784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 677us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302413.403138:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789302413.403159:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302413.403170:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121558656:0@lo:400:kworker.0 00000100:00100000:3.0:1789302413.403215:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302413.403235:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121559552:0@lo:400:kworker.0 00000100:00100000:3.0:1789302413.403260:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302413.403298:0:17112:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789302413.403301:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121559424:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302413.403307:0:17112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789302413.403334:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121559296:0@lo:400:kworker.0 00000004:00000024:1.0:1789302413.403338:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789302413.403364:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302413.403395:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121559424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 228us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302413.403402:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789302413.403414:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121558656 00000100:00100000:1.0:1789302413.403418:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121558656 00000100:00100000:1.0:1789302413.403437:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121559296 00000100:00100000:1.0:1789302413.403440:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121559296 00000100:00100000:1.0:1789302413.403455:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789302413.403460:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121558656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302413.403535:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121558912:0@lo:8:kworker.0 00000400:00000100:0.0:1789302413.403562:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219121558912 offset 0 length 520: 4 00000100:00100000:0.0:1789302413.403586:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121559040:0@lo:8:kworker.0 00000400:00000100:0.0:1789302413.403601:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219121559040 offset 0 length 520: 4 00000100:00100000:0.0:1789302413.403640:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121559552 00000100:00100000:0.0:1789302413.403645:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121559552 00000100:00100000:0.0:1789302413.403950:0:17112:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789302413.403960:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302413.403966:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121559552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302413.404020:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121559552:12345-0@lo:400:kworker.0 Request processed in 54us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302413.404027:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302413.404149:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121558656:12345-0@lo:400:kworker.0 Request processed in 687us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302413.404158:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789302413.404234:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121558656:0@lo:400:kworker.0 00010000:00080000:3.0:1789302413.404249:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc3843ed180 x1876219121559552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302413.404275:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121559552:0@lo:400:kworker.0 00000100:00100000:1.0:1789302413.404326:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789302413.404335:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121559296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302413.404383:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121559296:12345-0@lo:400:kworker.0 Request processed in 50us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302413.404389:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789302413.404433:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121558784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302413.404448:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121559424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302413.411222:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876219121559168:12345-0@lo:400:kworker.0 Request processed in 8335us (10199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302413.411237:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789302413.411691:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc3843edc00 x1876219121559168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302413.411706:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876219121559168:0@lo:400:kworker.0 00000100:00100000:3.0:1789302413.411707:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121559296:0@lo:400:kworker.0 00010000:00010000:1.0:1789302413.851442:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789302413.913078:0:17842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1789302414.164968:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789302414.868312:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302415.893489:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302416.916799:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302417.941444:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789302418.519791:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789302418.519807:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789302418.519810:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789302418.519812:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789302418.519827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789302418.519837:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789302418.519840:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789302418.519843:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789302418.520058:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121559680:0@lo:400:kworker.0 00000100:00100000:1.0:1789302418.520142:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302418.520363:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121559680 00000100:00100000:2.0:1789302418.520372:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121559680 00000100:00100000:2.0:1789302418.520421:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789302418.520431:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:3646:x1876219121559680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302418.520483:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:3646:x1876219121559680:12345-0@lo:400:kworker.0 Request processed in 53us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302418.520490:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789302418.520576:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121559680:0@lo:400:kworker.0 00000100:00100000:1.0:1789302418.520584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121560192:0@lo:400:kworker.0 00000100:00100000:1.0:1789302418.520619:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302418.520663:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302418.520669:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121560064:0@lo:400:kworker.0 00000100:00100000:1.0:1789302418.520691:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302418.520716:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121560064 00000100:00100000:1.0:1789302418.520720:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121560064 00000100:00100000:1.0:1789302418.520743:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302418.520749:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121560064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302418.520782:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121560064:12345-0@lo:400:kworker.0 Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302418.520788:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302418.520815:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121560064:0@lo:400:kworker.0 00000100:00100000:2.0:1789302418.520868:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121560192 00000100:00100000:2.0:1789302418.520872:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121560192 00000100:00100000:2.0:1789302418.520902:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302418.520909:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121560192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302418.520940:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876219121560192:12345-0@lo:400:kworker.0 Request processed in 32us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302418.520946:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789302418.520980:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc384052300 x1876219121560192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302418.520991:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876219121560192:0@lo:400:kworker.0 00000100:00100000:2.0:1789302418.523392:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121559808:0@lo:400:kworker.0 00000100:00100000:2.0:1789302418.523452:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302418.523489:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121560320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302418.523510:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302418.523543:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302418.523550:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121559936:0@lo:400:kworker.0 00000100:00100000:2.0:1789302418.523574:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302418.523610:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121559936 00000100:00100000:2.0:1789302418.523618:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121559936 00000100:00100000:2.0:1789302418.523660:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789302418.523667:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121559936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302418.523711:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121559936:12345-0@lo:400:kworker.0 Request processed in 44us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302418.523718:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789302418.523740:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121559808 00000100:00100000:2.0:1789302418.523742:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121559808 00000100:00100000:2.0:1789302418.523760:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121560320 00000100:00100000:2.0:1789302418.523762:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121560320 00000100:00100000:2.0:1789302418.523773:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789302418.523778:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121559808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302418.523805:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121559808:12345-0@lo:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302418.523811:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789302418.523820:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789302418.523825:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121560320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302418.523844:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789302418.523868:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121560320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302418.523873:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789302418.523902:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cc384053b80 x1876219121559936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302418.523926:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121559936:0@lo:400:kworker.0 00000100:00100000:2.0:1789302418.523936:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121559808:0@lo:400:kworker.0 00000100:00100000:2.0:1789302418.523947:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121560320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302418.528536:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121560448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302418.528605:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302418.529754:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121560448 00000100:00100000:0.0:1789302418.529765:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121560448 00000100:00100000:0.0:1789302418.529816:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789302418.529825:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121560448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302418.529859:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789302418.535133:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121560448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5281us (6501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302418.535148:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789302418.538875:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121560448:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1789302418.564591:0:18612:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789302418.564595:0:18612:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789302418.564596:0:18612:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789302418.564700:0:18612:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cc485d4e000 00000020:01000004:2.0:1789302418.564714:0:18612:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789302418.564737:0:18612:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789302418.564750:0:18612:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cc4aa9399c0) 00000020:00000080:2.0:1789302418.564765:0:18612:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789302418.657655:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789302418.659759:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789302418.660528:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789302418.661681:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789302418.661947:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789302418.662396:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789302418.662671:0:18612:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1789302418.665865:0:18612:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789302418.666802:0:18612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789302418.666818:0:18612:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789302418.666832:0:18612:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1ff82925bd39a610 00000020:01000004:3.0:1789302418.666838:0:18612:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789302418.666860:0:18612:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.109@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789302418.666864:0:18612:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789302418.666871:0:18612:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789302418.666876:0:18612:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789302418.666887:0:18612:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cc4bd344d40) 00000020:00000080:3.0:1789302418.666899:0:18612:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789302418.668168:0:18612:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302418.668353:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789302418.668359:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789302418.673386:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789302418.673399:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789302418.674712:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789302418.674724:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789302418.691016:0:18612:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789302418.691248:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789302418.691254:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789302418.697413:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789302418.697441:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789302418.735796:0:18612:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302418.737620:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789302418.737632:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789302418.739038:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789302418.739058:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789302418.740460:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789302418.740471:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789302418.749637:0:18612:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302418.749835:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789302418.749841:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789302418.752185:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789302418.752197:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789302418.812925:0:18612:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302418.813138:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789302418.813146:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789302418.814476:0:18612:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789302418.814487:0:18612:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789302418.815074:0:18612:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789302418.815103:0:18612:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789302418.815139:0:18612:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789302418.851233:0:18612:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789302418.851488:0:18612:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.109@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789302418.851493:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789302418.851495:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789302418.851496:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302418.851497:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302418.851498:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302418.851499:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302418.851500:0:18612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302418.851502:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302418.851503:0:18612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789302418.851506:0:18612:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789302418.851514:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302418.851515:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789302418.851516:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302418.851517:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302418.851518:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302418.851519:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302418.851520:0:18612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302418.851520:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302418.851521:0:18612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789302418.851547:0:18612:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789302418.851565:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121560576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789302418.851643:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302418.851690:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789302418.852073:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121560576 00000100:00100000:3.0:1789302418.852081:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121560576 00000100:00100000:3.0:1789302418.852367:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789302418.852379:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:18612:x1876219121560576:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789302418.852536:0:17104:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789302418.852540:0:17104:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789302418.852543:0:17104:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789302418.853648:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:18612:x1876219121560576:12345-0@lo:253:mount.lustre.0 Request processed in 1268us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302418.853659:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789302418.854452:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121560576:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789302418.854468:0:18612:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789302418.854471:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789302418.854473:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789302418.854475:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302418.854476:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302418.854478:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302418.854479:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302418.854480:0:18612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302418.854482:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302418.854484:0:18612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789302418.854508:0:18612:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cc485d4e000 from lustre-OST0000 10000000:01000000:2.0:1789302418.854536:0:18612:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789302418.854539:0:18612:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789302418.854547:0:18612:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cc4bd978000 local copy 00010000:00010000:2.0:1789302418.854558:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302418.854657:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121560704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302418.854698:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302418.854784:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789302418.854883:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121560704 00000100:00100000:0.0:1789302418.854891:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121560704 00000100:00100000:0.0:1789302418.854983:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789302418.854994:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:18612:x1876219121560704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302418.855080:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:18612:x1876219121560704:12345-0@lo:501:mount.lustre.0 Request processed in 88us (381us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302418.855088:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789302418.855172:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121560704:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789302418.855185:0:18612:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789302418.855205:0:18612:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789302418.855212:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302418.855220:0:18612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302418.855245:0:18612:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cc485d4e000 10000000:01000000:3.0:1789302418.855250:0:18612:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789302418.855255:0:18612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789302418.855257:0:18612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789302418.855261:0:18612:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789302418.855285:0:18612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789302418.855315:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982200/0x1ff82925bd39a61e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302418.855323:0:18612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982200/0x1ff82925bd39a61e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302418.855332:0:18612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982200/0x1ff82925bd39a61e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302418.855346:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121560832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789302418.855375:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302418.862458:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302418.864439:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121560832 00000100:00100000:2.0:1789302418.864452:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121560832 00000100:00100000:2.0:1789302418.864517:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789302418.864526:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+18:18612:x1876219121560832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302418.864542:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302418.864560:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5348400/0x1ff82925bd39a625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a61e expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302418.864588:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5348400/0x1ff82925bd39a625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a61e expref: 19 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302418.864599:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5348400/0x1ff82925bd39a625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a61e expref: 19 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302418.864608:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348400, rc 0) 00000100:00100000:2.0:1789302418.864672:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:18612:x1876219121560832:12345-0@lo:101:mount.lustre.0 Request processed in 147us (9295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302418.864678:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789302418.865665:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121560832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302418.865689:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982200/0x1ff82925bd39a61e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a625 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302418.865700:0:18612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982200/0x1ff82925bd39a61e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a625 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302418.869686:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789302418.870522:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302418.873094:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789302418.874484:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789302418.874512:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789302418.874527:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789302418.874542:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789302418.874555:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789302418.874582:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789302418.874588:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789302418.874683:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121560960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302418.874760:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302418.874837:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302418.878428:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121560960 00000100:00100000:2.0:1789302418.878443:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121560960 00000100:00100000:3.0:1789302418.878564:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789302418.878575:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:18612:x1876219121560960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302418.878778:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:18612:x1876219121560960:12345-0@lo:501:mount.lustre.0 Request processed in 204us (4017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302418.878786:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789302418.878984:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121560960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302418.879034:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302418.879088:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302418.879150:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302418.879254:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121561088 00000100:00100000:1.0:1789302418.879261:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121561088 00000100:00100000:1.0:1789302418.879310:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789302418.879318:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:18612:x1876219121561088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302418.880880:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:18612:x1876219121561088:12345-0@lo:503:mount.lustre.0 Request processed in 1558us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302418.880900:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789302418.881539:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561088:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789302418.883036:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789302418.883253:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302418.883403:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302418.883482:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302418.891423:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121561216 00000100:00100000:3.0:1789302418.891440:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121561216 00000100:00100000:3.0:1789302418.891496:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789302418.891508:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:18612:x1876219121561216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302418.892374:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:18612:x1876219121561216:12345-0@lo:502:mount.lustre.0 Request processed in 867us (8968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302418.892384:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789302418.892487:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302418.892736:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789302418.892782:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789302418.892799:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789302418.892812:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789302418.892827:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789302418.892840:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789302418.892852:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789302418.892865:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789302418.892877:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789302418.892890:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789302418.892902:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789302418.892915:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789302418.892950:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302418.893010:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302418.893045:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302418.893386:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121561344 00000100:00100000:3.0:1789302418.893393:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121561344 00000100:00100000:3.0:1789302418.893426:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789302418.893434:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:18612:x1876219121561344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302418.893530:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:18612:x1876219121561344:12345-0@lo:502:mount.lustre.0 Request processed in 95us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302418.893537:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789302418.893660:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302418.893708:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789302418.893717:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789302418.894536:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789302418.894544:0:18629:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789302418.894550:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302418.894552:0:18629:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789302418.894557:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789302418.894572:0:18629:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cc4ac2ab380) 00000020:00000080:2.0:1789302418.894594:0:18629:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789302418.894599:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789302418.894689:0:18629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc485d4e000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789302418.894697:0:18629:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789302418.894704:0:18629:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1ff82925bd39a633 00010000:00010000:1.0:1789302418.902887:0:18629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789302418.903753:0:18629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789302418.923631:0:18629:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789302418.930153:0:18629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789302418.930165:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302418.930177:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.930180:0:18629:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789302418.930185:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789302418.930187:0:18629:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1789302418.930189:0:18629:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789302418.930191:0:18629:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789302418.930192:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789302418.930195:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.930197:0:18629:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789302418.930199:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302418.930202:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.930203:0:18629:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789302418.930206:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789302418.930208:0:18629:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789302418.930210:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302418.930212:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.930213:0:18629:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789302418.930216:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302418.930218:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.930219:0:18629:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789302418.930223:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789302418.930251:0:18629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302418.930255:0:18629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.930256:0:18629:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789302418.930260:0:18629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789302418.932201:0:18612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789302418.932242:0:18612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789302418.932263:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982200/0x1ff82925bd39a61e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a625 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302418.932304:0:18612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982200/0x1ff82925bd39a61e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a625 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302418.932314:0:18612:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc485d4e000 from 1 10000000:01000000:3.0:1789302418.932317:0:18612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789302418.932353:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302418.932361:0:18612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302418.932373:0:18612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302418.932397:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789302418.932469:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302418.932509:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302418.932674:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121561472 00000100:00100000:2.0:1789302418.932682:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121561472 00000100:00100000:2.0:1789302418.932726:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789302418.932734:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:18612:x1876219121561472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302418.932746:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302418.932759:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd39a641 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a63a expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302418.932780:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd39a641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a63a expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302418.932791:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd39a641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a63a expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302418.932799:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349400, rc 0) 00000100:00100000:2.0:1789302418.932848:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:18612:x1876219121561472:12345-0@lo:101:mount.lustre.0 Request processed in 114us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302418.932854:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789302418.932931:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302418.932945:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302418.932953:0:18612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302418.938303:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789302418.938579:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302418.938762:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789302418.938787:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789302418.938807:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789302418.938813:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789302418.938884:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302418.938946:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302418.939057:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302418.939140:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121561600 00000100:00100000:2.0:1789302418.939147:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121561600 00000100:00100000:2.0:1789302418.939195:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789302418.939204:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:18612:x1876219121561600:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302418.939321:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:18612:x1876219121561600:12345-0@lo:501:mount.lustre.0 Request processed in 117us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302418.939330:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789302418.939528:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302418.939561:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302418.939600:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302418.939657:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49018ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302418.943354:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121561728 00000100:00100000:3.0:1789302418.943366:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121561728 00000100:00100000:3.0:1789302418.943502:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789302418.943513:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:18612:x1876219121561728:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789302418.943676:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:18612:x1876219121561728:12345-0@lo:503:mount.lustre.0 Request processed in 164us (4073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302418.943684:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789302418.943779:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561728:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789302418.944239:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789302418.944343:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302418.944387:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302418.944914:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121561856 00000100:00100000:2.0:1789302418.944929:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121561856 00000100:00100000:2.0:1789302418.945011:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789302418.945020:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:18612:x1876219121561856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302418.945137:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:18612:x1876219121561856:12345-0@lo:502:mount.lustre.0 Request processed in 118us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302418.945145:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302418.945329:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49a6e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1789302418.945354:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789302418.945697:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789302418.945724:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789302418.945736:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789302418.945747:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789302418.945760:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789302418.945774:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789302418.945787:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789302418.945798:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789302418.945810:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789302418.945821:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789302418.945832:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789302418.945860:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789302418.945900:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302418.945973:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0462cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302418.946061:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121561984 00000100:00100000:2.0:1789302418.946067:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121561984 00000100:00100000:2.0:1789302418.951091:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789302418.951131:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:18612:x1876219121561984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302418.952745:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:18612:x1876219121561984:12345-0@lo:502:mount.lustre.0 Request processed in 1635us (6837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302418.952759:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789302418.953040:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121561984:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789302418.953520:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789302418.953536:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789302418.959826:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302418.959839:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.959842:0:18633:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789302418.959850:0:18633:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc485d4e000 00000020:00000080:0.0:1789302418.959852:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302418.959860:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302418.959862:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.959863:0:18633:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789302418.959866:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302418.959867:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.959869:0:18633:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789302418.959872:0:18633:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc485d4e000 00000020:00000080:0.0:1789302418.959880:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302418.959944:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302418.959948:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.959949:0:18633:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789302418.959953:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302418.959966:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.959968:0:18633:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789302418.959972:0:18633:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc485d4e000 00000020:00000080:0.0:1789302418.959974:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302418.959993:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302418.959996:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.959998:0:18633:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789302418.960001:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302418.960004:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.960005:0:18633:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789302418.960009:0:18633:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc485d4e000 00000020:00000080:0.0:1789302418.960011:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302418.960034:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302418.960037:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302418.960039:0:18633:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789302418.960042:0:18633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789302418.960222:0:18612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789302418.960252:0:18612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302418.960286:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302418.960298:0:18612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302418.960354:0:18612:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789302418.960357:0:18612:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cc485d4e000 10000000:01000000:1.0:1789302418.960360:0:18612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cc485d4e000 10000000:01000000:1.0:1789302418.960364:0:18612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789302418.960370:0:18612:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc485d4e000 from 1 10000000:01000000:1.0:1789302418.960372:0:18612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789302418.960418:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302418.960432:0:18612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302418.960444:0:18612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a648 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302418.960468:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789302418.960534:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302418.960572:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302418.960594:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121562112 00000100:00100000:1.0:1789302418.960601:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121562112 00000100:00100000:1.0:1789302418.960643:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789302418.960651:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:18612:x1876219121562112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302418.960664:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302418.960675:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a64f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a648 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302418.960696:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a648 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302418.960707:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc3839abe00/0x1ff82925bd39a64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a648 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302418.960715:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839abe00, rc 0) 00000100:00100000:1.0:1789302418.960751:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121562112:12345-0@lo:101:mount.lustre.0 Request processed in 100us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302418.960758:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789302418.960814:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302418.960829:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a64f expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302418.960837:0:18612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a648 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a64f expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789302418.963803:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789302418.964080:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302418.964333:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789302418.964362:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789302418.964376:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789302418.964390:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789302418.967229:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789302418.967319:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789302418.967339:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789302418.967378:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789302418.967395:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789302418.967423:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789302418.967440:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789302418.967457:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789302418.967473:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789302418.967490:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789302418.967505:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789302418.967521:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789302418.967537:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789302418.967553:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789302418.967568:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789302418.967584:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789302418.967600:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789302418.967616:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789302418.967632:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789302418.967670:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789302418.967688:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789302418.967705:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789302418.967722:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789302418.967738:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789302418.967754:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789302418.967771:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789302418.967786:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789302418.967802:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789302418.967818:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789302418.967833:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789302418.967849:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789302418.967865:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789302418.967880:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789302418.967908:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789302418.967915:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789302418.968031:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302418.968098:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302418.968173:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121562240 00000100:00100000:1.0:1789302418.968180:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121562240 00000100:00100000:1.0:1789302418.968225:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789302418.968234:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121562240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302418.968359:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121562240:12345-0@lo:501:mount.lustre.0 Request processed in 126us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302418.968367:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789302418.968424:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8000 going to sleep for 11 seconds 00000100:00100000:1.0:1789302418.968445:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302418.968476:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302418.968514:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302418.968543:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121562368 00000100:00100000:1.0:1789302418.968547:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121562368 00000100:00100000:1.0:1789302418.968569:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789302418.968575:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121562368:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302418.968644:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121562368:12345-0@lo:503:mount.lustre.0 Request processed in 68us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302418.968651:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789302418.968685:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8000 going to sleep for 11 seconds 00000100:00100000:1.0:1789302418.968698:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562368:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789302418.969056:0:18612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789302418.969151:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302418.969187:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302418.969211:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121562496 00000100:00100000:1.0:1789302418.969215:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121562496 00000100:00100000:1.0:1789302418.969238:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789302418.969245:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121562496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302418.969332:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121562496:12345-0@lo:502:mount.lustre.0 Request processed in 87us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302418.969338:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789302418.969366:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383a38240 going to sleep for 11 seconds 00000100:00100000:1.0:1789302418.969378:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789302418.969517:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789302418.969539:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789302418.969550:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789302418.969563:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789302418.969575:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789302418.969586:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789302418.969609:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789302418.969622:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789302418.969634:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789302418.969646:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789302418.969658:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789302418.969670:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789302418.969683:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789302418.969696:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789302418.969707:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789302418.969734:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789302418.969748:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789302418.969762:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789302418.969776:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789302418.969789:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789302418.969801:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789302418.969812:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789302418.969822:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789302418.969835:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789302418.969847:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789302418.969860:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789302418.969873:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789302418.969884:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789302418.969895:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789302418.969906:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789302418.969918:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789302418.969945:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789302418.969961:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789302418.969975:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789302418.969988:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789302418.970001:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789302418.970012:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789302418.970025:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789302418.970037:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789302418.970062:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789302418.970075:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789302418.970088:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789302418.970101:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789302418.970140:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789302418.970157:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789302418.970172:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789302418.970185:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789302418.970210:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789302418.970248:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562624:0@lo:502:mount.lustre.0 00010000:00010000:3.0:1789302418.971512:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302418.976880:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302418.976926:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121562624 00000100:00100000:1.0:1789302418.976935:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121562624 00000100:00100000:1.0:1789302418.978382:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789302418.978395:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121562624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302418.978530:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121562624:12345-0@lo:502:mount.lustre.0 Request processed in 140us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302418.978538:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789302418.978589:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3829e8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302418.978608:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789302418.978792:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789302418.978819:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789302418.978852:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302418.978893:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302418.978910:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383a38240 going to sleep for 11 seconds 00000100:00100000:2.0:1789302418.979706:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121562752 00000100:00100000:2.0:1789302418.979714:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121562752 00000100:00100000:2.0:1789302418.979749:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789302418.979756:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121562752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302418.983200:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121562752:12345-0@lo:502:mount.lustre.0 Request processed in 3434us (4297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302418.983216:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789302418.989654:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121562752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789302418.989745:0:18612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789302418.989765:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789302418.994322:0:18638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789302418.994339:0:18638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cc4ac2a99c0) 00000020:00000080:2.0:1789302418.994362:0:18638:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789302418.994454:0:18638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc485d4e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789302418.994459:0:18638:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc485d4e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789302418.994461:0:18638:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc485d4e000 3 00010000:00080000:2.0:1789302418.994502:0:18638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc3829c4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.109@tcp at head 00010000:00010000:1.0:1789302419.014467:0:18638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789302419.014669:0:18638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789302419.014719:0:18638:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789302419.014732:0:18638:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1ff82925bd39a65d 00000100:00080000:1.0:1789302419.014742:0:18638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789302419.014946:0:18638:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cc3829c4000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302419.015050:0:18638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc3843eea00 x1876219121562880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302419.015081:0:18638:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789302419.015173:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876219121562880:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789302419.015205:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302419.015209:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789302419.015211:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302419.015214:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789302419.015237:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789302419.015248:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302419.015251:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789302419.015253:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302419.015256:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789302419.015290:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121563008:0@lo:400:kworker.0 00000100:00100000:0.0:1789302419.015312:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121562880 00000100:00100000:0.0:1789302419.015319:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121562880 00000100:00100000:1.0:1789302419.015321:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302419.015341:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302419.015347:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121563136:0@lo:400:kworker.0 00000100:00100000:0.0:1789302419.015348:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302419.015354:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121562880:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789302419.015366:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789302419.015376:0:17112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000100:00100000:1.0:1789302419.015396:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121563264:0@lo:400:kworker.0 00000020:00000080:0.0:1789302419.015404:0:17112:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1ff82925bd39a664 00000004:00100000:0.0:1789302419.015417:0:17112:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789302419.015448:0:17112:0:(import.c:65:import_set_state_nolock()) ffff8cc383a99000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302419.015498:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302419.015504:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876219121562880:12345-0@lo:38:llog_process_th.0 Request processed in 150us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302419.015512:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302419.015515:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302419.015520:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121563392:0@lo:400:kworker.0 00000100:00100000:0.0:1789302419.015524:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121563136 00000100:00100000:0.0:1789302419.015527:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121563136 00000100:00100000:1.0:1789302419.015539:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302419.015898:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121563392 00000100:00100000:0.0:1789302419.015903:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121563392 00000100:00100000:0.0:1789302419.015924:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302419.015930:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121563136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302419.015976:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121563136:12345-0@lo:400:kworker.0 Request processed in 45us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302419.015982:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302419.015994:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302419.016000:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121563392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302419.016032:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121563392:12345-0@lo:400:kworker.0 Request processed in 32us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302419.016038:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302419.016063:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121563008 00000100:00100000:0.0:1789302419.016069:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121563008 00000100:00100000:0.0:1789302419.016095:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121563264 00000100:00100000:0.0:1789302419.016098:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121563264 00000100:00100000:0.0:1789302419.016141:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302419.016148:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121563008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302419.016179:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121563008:12345-0@lo:400:kworker.0 Request processed in 31us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302419.016184:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302419.016196:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789302419.016202:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121563264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302419.016250:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121563264:12345-0@lo:400:kworker.0 Request processed in 48us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302419.016256:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789302419.016384:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc3843edc00 x1876219121563392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302419.016400:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121563392:0@lo:400:kworker.0 00000100:00100000:0.0:1789302419.016411:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121563264:0@lo:400:kworker.0 00010000:00080000:0.0:1789302419.016443:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc3843eea00 x1876219121562880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302419.016451:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789302419.016457:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789302419.016464:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789302419.016469:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789302419.016472:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc3829c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789302419.016478:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876219121562880:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789302419.019609:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc3843ee300 x1876219121563136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302419.019630:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121563136:0@lo:400:kworker.0 00000100:00100000:2.0:1789302419.019644:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121563008:0@lo:400:kworker.0 00000020:01000004:1.0:1789302419.019943:0:18638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789302419.020194:0:18638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8cc381fc3380) 00000020:00000080:1.0:1789302419.020218:0:18638:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789302419.020314:0:18638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc485d4e000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789302419.020318:0:18638:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc485d4e000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789302419.020320:0:18638:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc485d4e000 3 00010000:00080000:1.0:1789302419.020349:0:18638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc382634800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.109@tcp at head 00010000:00010000:0.0:1789302419.025451:0:18638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1789302419.031719:0:18638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789302419.031773:0:18638:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789302419.031787:0:18638:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x1ff82925bd39a672 00000100:00080000:0.0:1789302419.031798:0:18638:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789302419.031810:0:18638:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8cc382634800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302419.031846:0:18638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc484fe2300 x1876219121563520/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302419.031885:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876219121563520:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789302419.031958:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302419.032014:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121563520 00000100:00100000:0.0:1789302419.032021:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121563520 00000100:00100000:0.0:1789302419.032051:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789302419.032058:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121563520:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789302419.032084:0:17112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1789302419.032377:0:17112:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x1ff82925bd39a679 00000004:00100000:0.0:1789302419.032393:0:17112:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789302419.032802:0:17112:0:(import.c:65:import_set_state_nolock()) ffff8cc383a9d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302419.032864:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876219121563520:12345-0@lo:38:llog_process_th.0 Request processed in 805us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302419.032873:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789302419.032924:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc484fe2300 x1876219121563520/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302419.032936:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789302419.032943:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789302419.032949:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789302419.032954:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789302419.032956:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc382634800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789302419.032963:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876219121563520:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789302419.032984:0:18638:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789302419.034178:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789302419.034184:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789302419.034186:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789302419.034189:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789302419.034193:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789302419.034196:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789302419.034198:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789302419.034201:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789302419.035068:0:18638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789302419.035194:0:18612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789302419.035229:0:18612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789302419.035249:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a648 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a64f expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302419.035334:0:18612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa600/0x1ff82925bd39a648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a64f expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789302419.035389:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789302419.035392:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789302419.035394:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302419.035395:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302419.035396:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302419.035397:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302419.035399:0:18612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302419.035501:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302419.035503:0:18612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789302419.035507:0:18612:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789302419.035509:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789302419.035510:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789302419.035512:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302419.035513:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302419.035514:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302419.035515:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302419.035516:0:18612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302419.035517:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302419.035518:0:18612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789302419.035542:0:18612:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789302419.035564:0:18612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121563648:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789302419.035622:0:18612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302419.035663:0:18612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4912e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1789302419.036163:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121563648 00000100:00100000:0.0:1789302419.036172:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121563648 00000100:00100000:0.0:1789302419.036220:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789302419.036230:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121563648:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789302419.036266:0:17102:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789302419.036289:0:17102:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789302419.039632:0:17102:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789302419.039651:0:17102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789302419.039675:0:17126:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789302419.039680:0:17126:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789302419.039702:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302419.039720:0:17126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc3839ab200/0x1ff82925bd39a5ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a5c3 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302419.039728:0:17126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc3839aa400/0x1ff82925bd39a5d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a5d1 expref: 21 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302419.039736:0:17126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302419.039775:0:17126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc3839aa400/0x1ff82925bd39a5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a5d1 expref: 21 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302419.039788:0:17126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc3839aa400/0x1ff82925bd39a5d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a5d1 expref: 21 pid: 17102 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302419.039803:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121563776:0@lo:104: 00000100:00100000:3.0:1789302419.039862:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789302419.039943:0:17126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc3839ab200/0x1ff82925bd39a5ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a5c3 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302419.039952:0:17126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc3839ab200/0x1ff82925bd39a5ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a5c3 expref: 21 pid: 17105 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302419.039960:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:18612:x1876219121563648:12345-0@lo:253:mount.lustre.0 Request processed in 3731us (4336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302419.039970:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789302419.039972:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121563904:0@lo:104: 00000100:00100000:3.0:1789302419.039996:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302419.040049:0:18612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:18612:1876219121563648:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789302419.040061:0:18612:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789302419.040064:0:18612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789302419.040066:0:18612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789302419.040067:0:18612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302419.040069:0:18612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302419.040070:0:18612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302419.040071:0:18612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302419.040077:0:18612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789302419.040080:0:18612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302419.040081:0:18612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789302419.040094:0:18612:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789302419.044676:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4912e2e40 going to sleep for 11 seconds 00000001:00000004:3.0:1789302419.047567:0:18612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789302419.047769:0:17093:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789302419.047794:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121563776 00000100:00100000:0.0:1789302419.047803:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121563776 00000100:00100000:0.0:1789302419.047840:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121563904 00000100:00100000:0.0:1789302419.047843:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121563904 00000100:00100000:0.0:1789302419.047861:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302419.047871:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+4:17126:x1876219121563776:12345-0@lo:104: 00010000:00010000:0.0:1789302419.047917:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048008:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302419.048014:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+4:17126:x1876219121563776:12345-0@lo:104: Request processed in 145us (8152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302419.048021:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302419.048038:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302419.048044:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adf5a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:17126:x1876219121563904:12345-0@lo:104: 00010000:00010000:0.0:1789302419.048061:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048096:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789302419.048101:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adf5a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:17126:x1876219121563904:12345-0@lo:104: Request processed in 58us (8105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302419.048107:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789302419.048173:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789302419.048179:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048187:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982e00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:0.0:1789302419.048192:0:17098:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048200:0:17098:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302419.048208:0:17098:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302419.048214:0:17098:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789302419.048246:0:17098:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048253:0:17098:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302419.048272:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048288:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982e00/0x1ff82925bd39a5d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a5d8 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048308:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302419.048311:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048317:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311de00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:0.0:1789302419.048320:0:17098:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048327:0:17098:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302419.048333:0:17098:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302419.048338:0:17098:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789302419.048352:0:17098:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048358:0:17098:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302419.048365:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048373:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48311de00/0x1ff82925bd39a5c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a5ca expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302419.048387:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302419.048389:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302419.048391:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302419.048527:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121564032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302419.048566:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302419.048609:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302419.048615:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121564160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302419.048643:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302419.048680:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121564032 00000100:00100000:2.0:1789302419.048692:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121564032 00010000:00010000:2.0:1789302419.048717:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc3839aa400/0x1ff82925bd39a5d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a5d1 expref: 21 pid: 17102 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302419.048738:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121564160 00000100:00100000:2.0:1789302419.048741:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121564160 00010000:00010000:2.0:1789302419.048752:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc3839ab200/0x1ff82925bd39a5ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a5c3 expref: 22 pid: 17105 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302419.048765:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302419.048771:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:3645:x1876219121564032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302419.048781:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302419.048786:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc3839aa400/0x1ff82925bd39a5d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a5d1 expref: 22 pid: 17102 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.048797:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc3839aa400/0x1ff82925bd39a5d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a5d1 expref: 22 pid: 17102 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.048812:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302419.048839:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:3645:x1876219121564032:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302419.048846:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302419.048859:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302419.048864:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbe0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:3645:x1876219121564160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302419.048871:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302419.048875:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc3839ab200/0x1ff82925bd39a5ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a5c3 expref: 21 pid: 17105 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.048884:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc3839ab200/0x1ff82925bd39a5ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a5c3 expref: 21 pid: 17105 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.048905:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.048913:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789302419.048962:0:17096:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009282393s 00010000:00010000:2.0:1789302419.048968:0:17096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.048976:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.048983:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.048990:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.048995:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983000 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302419.048999:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.049006:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.049015:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.049025:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302419.049050:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbe0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:3645:x1876219121564160:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302419.049063:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302419.049189:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121564160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302419.049198:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121564032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302419.049202:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302419.049228:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc3839aa400/0x1ff82925bd39a5d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a5d1 expref: 20 pid: 17102 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302419.049240:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121563776:0@lo:104: 00010000:00010000:2.0:1789302419.049249:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc3839ab200/0x1ff82925bd39a5ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a5c3 expref: 19 pid: 17105 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302419.049257:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121563904:0@lo:104: 00010000:00010000:2.0:1789302419.049271:0:17126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.049291:0:17126:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.049298:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302419.049304:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a680 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789302419.051556:0:18612:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789302419.051574:0:18612:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789302419.051613:0:18612:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789302419.051653:0:18612:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789302419.051742:0:18612:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789302419.051768:0:18612:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789302419.052599:0:18612:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302419.052763:0:18612:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1789302419.974168:0:18691:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789302419.974405:0:18691:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789302419.988994:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789302420.437941:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789302420.630770:0:17107:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789302420.630778:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b5eab000 from 9 10000000:01000000:2.0:1789302420.630783:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789302420.630826:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302420.630845:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302420.630856:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302420.630881:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121564288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302420.630966:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302420.631015:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4901650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302420.631157:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121564288 00000100:00100000:0.0:1789302420.631166:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121564288 00000100:00100000:0.0:1789302420.631219:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789302420.631227:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+19:17107:x1876219121564288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302420.631240:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302420.631253:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48311d800/0x1ff82925bd39a68e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a687 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302420.631290:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48311d800/0x1ff82925bd39a68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a687 expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302420.631301:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48311d800/0x1ff82925bd39a68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a687 expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302420.631473:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48311d800, rc 0) 00000100:00100000:0.0:1789302420.631513:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:17107:x1876219121564288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 287us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302420.631520:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789302420.633046:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121564288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302420.633071:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302420.633083:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302420.633247:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121564416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789302420.633423:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302420.633460:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4901650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302420.635321:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121564416 00000100:00100000:0.0:1789302420.635333:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121564416 00000100:00100000:0.0:1789302420.635382:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789302420.635393:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:17107:x1876219121564416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789302420.635416:0:17102:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789302420.635440:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789302420.635443:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789302420.635554:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:17107:x1876219121564416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (2130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302420.635573:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789302420.637745:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121564416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789302420.637846:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789302420.637973:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302420.637985:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302420.638010:0:17107:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789302420.638013:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc38422d000 from 9 10000000:01000000:2.0:1789302420.638016:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789302420.638048:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302420.638057:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302420.638067:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302420.638086:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121564544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302420.638159:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302420.638214:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc482b970c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302420.638443:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121564544 00000100:00100000:1.0:1789302420.638451:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121564544 00000100:00100000:1.0:1789302420.638503:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789302420.638512:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:17107:x1876219121564544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302420.638524:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302420.638538:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc3839aac00/0x1ff82925bd39a69c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a695 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302420.638561:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc3839aac00/0x1ff82925bd39a69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a695 expref: 21 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302420.638571:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc3839aac00/0x1ff82925bd39a69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a695 expref: 21 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302420.638578:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aac00, rc 0) 00000100:00100000:1.0:1789302420.638632:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:17107:x1876219121564544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302420.638638:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789302420.638708:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384052a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121564544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302420.638721:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302420.638730:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302420.638780:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121564672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789302420.638812:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302420.638838:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4912e2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302420.640428:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121564672 00000100:00100000:1.0:1789302420.640439:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121564672 00000100:00100000:1.0:1789302420.640483:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789302420.640502:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:17107:x1876219121564672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789302420.640521:0:17105:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789302420.640537:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789302420.640540:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789302420.640641:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:17107:x1876219121564672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302420.640648:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789302420.640889:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121564672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789302420.640948:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789302420.640957:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302420.640967:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302421.016775:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302422.036598:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302423.061161:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302423.636357:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121564800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302423.636439:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302423.636519:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121564800 00000100:00100000:2.0:1789302423.636527:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121564800 00000100:00100000:2.0:1789302423.636825:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789302423.636836:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121564800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302423.636871:0:17116:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789302423.636917:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121564800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302423.636925:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789302423.636973:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121564800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302423.637306:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121564928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302423.637338:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302423.637384:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121564928 00000100:00100000:3.0:1789302423.637388:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121564928 00000100:00100000:3.0:1789302423.637427:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789302423.637434:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121564928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789302423.637452:0:17850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789302423.637497:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121564928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302423.637504:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789302423.637536:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121564928:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789302424.088412:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302424.151128:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302424.151198:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302424.151222:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121565184:0@lo:400:kworker.0 00000100:00100000:2.0:1789302424.151304:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302424.151365:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121565184 00000100:00100000:2.0:1789302424.151373:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121565184 00000100:00100000:2.0:1789302424.151418:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789302424.151427:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121565184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302424.151475:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121565184:12345-0@lo:400:kworker.0 Request processed in 49us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302424.151481:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789302424.151520:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121565184:0@lo:400:kworker.0 00000100:00100000:1.0:1789302424.151636:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121565056:0@lo:400:kworker.0 00000100:00100000:1.0:1789302424.151672:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302424.161996:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121565056 00000100:00100000:3.0:1789302424.162012:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121565056 00000100:00100000:3.0:1789302424.162090:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789302424.162102:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:3646:x1876219121565056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302424.162219:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:3646:x1876219121565056:12345-0@lo:400:kworker.0 Request processed in 119us (10544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302424.162226:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789302424.162386:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121565056:0@lo:400:kworker.0 00000100:00080000:0.0:1789302424.165282:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302424.165292:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789302424.165295:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302424.165298:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789302424.165361:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302424.165364:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789302424.165367:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302424.165369:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789302424.165420:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121565312:0@lo:400:kworker.0 00000100:00100000:0.0:1789302424.165487:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302424.165528:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121565824:0@lo:400:kworker.0 00000100:00100000:0.0:1789302424.165549:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302424.165575:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302424.165581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121565440:0@lo:400:kworker.0 00000100:00100000:0.0:1789302424.165606:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302424.165648:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121565312 00000100:00100000:0.0:1789302424.165656:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121565312 00000100:00100000:0.0:1789302424.165698:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121565824 00000100:00100000:0.0:1789302424.165701:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121565824 00000100:00100000:0.0:1789302424.165730:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302424.165754:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121565312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302424.165800:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121565312:12345-0@lo:400:kworker.0 Request processed in 48us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302424.165806:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302424.165822:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302424.165841:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121565824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302424.165865:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121565824:12345-0@lo:400:kworker.0 Request processed in 38us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302424.165870:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302424.165888:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121565440 00000100:00100000:0.0:1789302424.165891:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121565440 00000100:00100000:0.0:1789302424.165912:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789302424.165917:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121565440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302424.165944:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121565440:12345-0@lo:400:kworker.0 Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302424.165949:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789302424.165977:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789302424.166009:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121565440:0@lo:400:kworker.0 00010000:00080000:0.0:1789302424.166020:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc484fe0700 x1876219121565312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302424.166133:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121565568:0@lo:400:kworker.0 00000100:00100000:2.0:1789302424.166162:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302424.166181:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302424.166186:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121565696:0@lo:400:kworker.0 00000100:00100000:2.0:1789302424.166209:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302424.168198:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121565568 00000100:00100000:2.0:1789302424.168212:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121565568 00000100:00100000:2.0:1789302424.168275:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121565696 00000100:00100000:2.0:1789302424.168279:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121565696 00000100:00100000:2.0:1789302424.168314:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789302424.168323:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121565568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302424.168399:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121565568:12345-0@lo:400:kworker.0 Request processed in 78us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302424.168406:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789302424.168437:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789302424.168443:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121565696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302424.168475:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121565696:12345-0@lo:400:kworker.0 Request processed in 32us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302424.168480:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789302424.168521:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc484fe0380 x1876219121565696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302424.168535:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121565696:0@lo:400:kworker.0 00010000:00080000:2.0:1789302424.168547:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc484fe3800 x1876219121565568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302424.168554:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121565568:0@lo:400:kworker.0 00000100:00100000:0.0:1789302424.168908:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121565312:0@lo:400:kworker.0 00010000:00080000:0.0:1789302424.168926:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc484fe2300 x1876219121565824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302424.168934:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121565824:0@lo:400:kworker.0 00000100:00080000:0.0:1789302424.168973:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789302424.410343:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789302425.112650:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789302425.426032:0:18981:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789302426.132399:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789302426.484970:0:19033:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789302426.485295:0:19033:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789302427.157401:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302427.220319:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302412/real 1789302412] req@ffff8cc3843ee680 x1876219121558144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302427 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302427.220359:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc3843ee680 x1876219121558144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302427 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302427.220369:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302412/real 1789302412] req@ffff8cc3843ed880 x1876219121558272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302427 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302427.220380:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc3843ed880 x1876219121558272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302427 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789302427.220408:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5208000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302427.220438:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789302427.220457:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121558144:0@lo:8:kworker.0 00000100:00080000:2.0:1789302427.220464:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302427.220470:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789302427.220473:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121558272:0@lo:8:kworker.0 00000100:00100000:0.0:1789302427.220818:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121565952:0@lo:400:kworker.0 00000100:00100000:0.0:1789302427.220905:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302427.220968:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121565952 00000100:00100000:0.0:1789302427.220977:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121565952 00000100:00100000:0.0:1789302427.221031:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789302427.221041:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:3648:x1876219121565952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302427.221097:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:3648:x1876219121565952:12345-0@lo:400:kworker.0 Request processed in 57us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302427.221104:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1789302427.221302:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302427.221307:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302427.221310:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302427.221313:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302427.221330:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302427.221333:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789302427.221345:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5208000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302427.221349:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 488 00000100:00080000:3.0:1789302427.221354:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789302427.221364:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cc4b5208000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302427.221387:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd803100 x1876219121566464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302427.221402:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302427.221405:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789302427.221407:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302427.221411:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 488 00000100:00080000:3.0:1789302427.221413:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789302427.221417:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cc4b5138800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302427.221428:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd803b80 x1876219121566592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789302427.221493:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121566080:0@lo:400:kworker.0 00000100:00100000:3.0:1789302427.221534:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302427.221560:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121566848:0@lo:400:kworker.0 00000100:00100000:3.0:1789302427.221589:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302427.221609:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789302427.221614:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121566208:0@lo:400:kworker.0 00000100:00100000:3.0:1789302427.221636:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302427.221652:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121566976:0@lo:400:kworker.0 00000100:00100000:3.0:1789302427.221674:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302427.221700:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121566080 00000100:00100000:3.0:1789302427.221704:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121566080 00000100:00100000:2.0:1789302427.222430:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121566336:0@lo:400:kworker.0 00000100:00100000:2.0:1789302427.222476:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302427.222508:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302427.222515:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121566720:0@lo:400:kworker.0 00000100:00100000:2.0:1789302427.222538:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302427.222579:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121566848 00000100:00100000:2.0:1789302427.222586:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121566848 00000100:00100000:2.0:1789302427.222629:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121566208 00000100:00100000:2.0:1789302427.222631:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121566208 00000100:00100000:2.0:1789302427.222642:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121566976 00000100:00100000:2.0:1789302427.222644:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121566976 00000100:00100000:2.0:1789302427.222657:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121566720 00000100:00100000:2.0:1789302427.222659:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121566720 00000100:00100000:2.0:1789302427.222673:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302427.222681:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121566848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302427.222845:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121566336 00000100:00100000:3.0:1789302427.222850:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121566336 00000100:00100000:3.0:1789302427.222864:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302427.222870:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121566080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302427.222917:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121566080:12345-0@lo:400:kworker.0 Request processed in 46us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302427.222925:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302427.222945:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789302427.222951:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121566336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302427.222997:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121566336:12345-0@lo:400:kworker.0 Request processed in 46us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302427.223003:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789302427.223024:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789302427.223032:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121566208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302427.223062:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121566208:12345-0@lo:400:kworker.0 Request processed in 31us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302427.223068:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789302427.223083:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789302427.223089:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121566976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302427.223132:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121566976:12345-0@lo:400:kworker.0 Request processed in 43us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302427.223139:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789302427.223151:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302427.223157:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121566720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302427.223293:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121565952:0@lo:400:kworker.0 00000100:00100000:0.0:1789302427.223500:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121566464:0@lo:8:kworker.0 00000100:00100000:2.0:1789302427.225259:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121566848:12345-0@lo:400:kworker.0 Request processed in 2569us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302427.225277:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789302427.225329:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302427.225335:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789302427.225694:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd800000 x1876219121566208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302427.225712:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121566208:0@lo:400:kworker.0 00010000:00080000:2.0:1789302427.225764:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd801f80 x1876219121566976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302427.225775:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121566976:0@lo:400:kworker.0 00000100:00100000:2.0:1789302427.225788:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121566080:0@lo:400:kworker.0 00010000:00080000:2.0:1789302427.225801:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd801880 x1876219121566848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302427.225810:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121566848:0@lo:400:kworker.0 00000100:00100000:3.0:1789302427.225957:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121566720:12345-0@lo:400:kworker.0 Request processed in 2798us (3415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302427.226031:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789302427.226074:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd803480 x1876219121566720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302427.226085:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121566720:0@lo:400:kworker.0 00000100:00100000:3.0:1789302427.226098:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121566336:0@lo:400:kworker.0 00000100:00100000:1.0:1789302427.226469:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302427.226552:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121566592:0@lo:8:kworker.0 00000100:00100000:1.0:1789302427.226584:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302427.226808:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121566464 00000100:00100000:3.0:1789302427.226817:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121566464 00000100:00100000:3.0:1789302427.226854:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121566592 00000100:00100000:3.0:1789302427.226857:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121566592 00000100:00100000:3.0:1789302427.226871:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302427.226879:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876219121566464:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789302427.226915:0:18616:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:3.0:1789302427.226946:0:18616:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd39a6a3 00002000:00100000:3.0:1789302427.226961:0:18616:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8cc4b7ef0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789302427.226966:0:18616:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789302427.227068:0:18616:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789302427.227488:0:18616:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789302427.227524:0:18616:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7ef5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302427.227633:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876219121566464:12345-0@lo:8:kworker.0 Request processed in 752us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302427.227641:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302427.227666:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302427.227671:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876219121566592:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789302427.227687:0:18616:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789302427.231402:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd803100 x1876219121566464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302427.231422:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789302427.231435:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789302427.231446:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789302427.231454:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789302427.231481:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5208000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789302427.232087:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789302427.232101:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121566464:0@lo:8:kworker.0 00000004:00080000:0.0:1789302427.232495:0:17851:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789302427.232628:0:17851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 503275515132ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789302427.232636:0:17851:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789302427.237150:0:17852:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789302427.237192:0:17852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17852:1876219121567232:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789302427.237299:0:17852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302427.237338:0:17852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b5351b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302427.237371:0:18618:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789302427.237379:0:18618:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789302427.237465:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121567104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302427.237537:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789302427.238445:0:17842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789302427.238848:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121567104 00000100:00100000:2.0:1789302427.238861:0:18620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121567104 00000100:00100000:2.0:1789302427.238964:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302427.238977:0:18620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876219121567104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789302427.239017:0:18620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789302427.239107:0:18620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876219121567104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302427.239154:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789302427.239250:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302427.239295:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc384051500 x1876219121567104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302427.239319:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121567104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789302427.245088:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121567232 00000100:00100000:2.0:1789302427.245107:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121567232 00000100:00100000:1.0:1789302427.246523:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302427.246544:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17852:x1876219121567232:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789302427.249011:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876219121566592:12345-0@lo:8:kworker.0 Request processed in 21329us (22417us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789302427.249029:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789302427.249585:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302427.249593:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789302427.249608:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121566592:0@lo:8:kworker.0 00002000:00080000:1.0:1789302427.252780:0:19064:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789302427.252796:0:19064:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789302427.253049:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17852:x1876219121567232:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6506us (15744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302427.253063:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789302427.263284:0:17852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc384053800 x1876219121567232/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789302443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302427.263308:0:17852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17852:1876219121567232:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789302427.263329:0:17852:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789302427.263391:0:17852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17852:1876219121567360:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789302427.263468:0:17852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302427.263518:0:17852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b5351b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302427.263604:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121567360 00000100:00100000:1.0:1789302427.263613:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121567360 00000100:00100000:1.0:1789302427.263683:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302427.263695:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17852:x1876219121567360:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789302427.263738:0:18618:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789302427.263783:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17852:x1876219121567360:12345-0@lo:5:osp-pre-0-1.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302427.263790:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789302427.264061:0:17852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc384053800 x1876219121567360/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302427.264073:0:17852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17852:1876219121567360:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789302427.264083:0:17852:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789302427.264141:0:17852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17852:1876219121567488:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789302427.264169:0:17852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302427.264194:0:17852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b5351b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302427.264256:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121567488 00000100:00100000:0.0:1789302427.264262:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121567488 00000100:00100000:0.0:1789302427.264310:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789302427.264319:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17852:x1876219121567488:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789302427.264352:0:18616:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1789302427.289059:0:18613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789302427.289083:0:18613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789302427.289525:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17852:x1876219121567488:12345-0@lo:5:osp-pre-0-1.0 Request processed in 25200us (25347us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789302427.289539:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789302427.289618:0:17852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc384053800 x1876219121567488/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302443 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302427.289632:0:17852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789302427.289640:0:17852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17852:1876219121567488:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789302427.289661:0:17852:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1789302427.289754:0:17852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17852:1876219121567616:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789302427.289802:0:17852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302427.289832:0:17852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc3839ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1789302427.289876:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121567616 00000100:00100000:3.0:1789302427.289885:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121567616 00000100:00100000:3.0:1789302427.289944:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302427.289956:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17852:x1876219121567616:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789302427.290011:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17852:x1876219121567616:12345-0@lo:900:osp-pre-0-1.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302427.290018:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789302427.290050:0:17852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f77480 x1876219121567616/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789302443 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302427.290060:0:17852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17852:1876219121567616:0@lo:900:osp-pre-0-1.0 00000020:00000004:3.0:1789302427.469034:0:19084:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789302427.469343:0:19084:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789302428.183475:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302428.756474:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121567744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302428.756584:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302428.756865:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121567744 00000100:00100000:2.0:1789302428.756880:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121567744 00000100:00100000:2.0:1789302428.756968:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302428.756982:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121567744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302428.757046:0:17850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789302428.757156:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121567744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 175us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302428.757163:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789302428.757333:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121567744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302428.758223:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121567872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302428.758275:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302428.758325:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121567872 00000100:00100000:3.0:1789302428.758331:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121567872 00000100:00100000:3.0:1789302428.758367:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302428.758376:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121567872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789302428.758401:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789302428.758442:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121567872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302428.758449:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302428.758486:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121567872:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789302429.204622:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302430.231918:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302430.677418:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789302431.254915:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302432.280286:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302432.341904:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121568000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789302432.341976:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302432.342052:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121568000 00000100:00100000:0.0:1789302432.342058:0:18620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121568000 00000100:00100000:0.0:1789302432.342127:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302432.342138:0:18620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121568000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302432.342163:0:18620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789302432.342216:0:18620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121568000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302432.342223:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789302432.342244:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302432.342272:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc484fe0700 x1876219121568000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302432.342289:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121568000:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789302432.343835:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302432.343840:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302432.343843:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302432.343846:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302432.343864:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302432.343867:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789302432.343871:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302432.343876:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:3.0:1789302432.343882:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789302432.343902:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cc4b5138800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:3.0:1789302432.343923:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc381f74380 x1876219121568640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789302432.344001:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121568256:0@lo:400:kworker.0 00000100:00100000:3.0:1789302432.344052:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302432.344141:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121568896:0@lo:400:kworker.0 00000100:00100000:3.0:1789302432.344168:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302432.344198:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789302432.344204:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121568128:0@lo:400:kworker.0 00000100:00100000:3.0:1789302432.344230:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302432.344251:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121568768:0@lo:400:kworker.0 00000100:00100000:3.0:1789302432.344273:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302432.344299:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121568256 00000100:00100000:3.0:1789302432.344305:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121568256 00000100:00100000:3.0:1789302432.344341:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789302432.344349:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121568256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302432.344392:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121568256:12345-0@lo:400:kworker.0 Request processed in 43us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302432.344398:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789302432.344421:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121568128 00000100:00100000:3.0:1789302432.344424:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121568128 00000100:00100000:3.0:1789302432.344444:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789302432.344450:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:3648:x1876219121568128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302432.344477:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:3648:x1876219121568128:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302432.344483:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789302432.344530:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121568128:0@lo:400:kworker.0 00000100:00100000:0.0:1789302432.345676:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121568896 00000100:00100000:0.0:1789302432.345686:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121568896 00000100:00100000:0.0:1789302432.345739:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121568768 00000100:00100000:0.0:1789302432.345742:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121568768 00000100:00100000:0.0:1789302432.345763:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789302432.345771:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121568896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302432.345822:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121568896:12345-0@lo:400:kworker.0 Request processed in 51us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302432.345839:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789302432.345854:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789302432.345860:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121568768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302432.345889:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121568768:12345-0@lo:400:kworker.0 Request processed in 29us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302432.345895:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789302432.345929:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121568384:0@lo:400:kworker.0 00000100:00100000:0.0:1789302432.345958:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302432.345980:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121569024:0@lo:400:kworker.0 00000100:00100000:0.0:1789302432.345999:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302432.346015:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302432.346023:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121568512:0@lo:400:kworker.0 00000100:00100000:0.0:1789302432.346044:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302432.346070:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121568512 00000100:00100000:0.0:1789302432.346073:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121568512 00000100:00100000:0.0:1789302432.346098:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789302432.346105:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121568512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302432.346168:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121568512:12345-0@lo:400:kworker.0 Request processed in 64us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302432.346175:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789302432.346200:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121568384 00000100:00100000:0.0:1789302432.346204:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121568384 00000100:00100000:0.0:1789302432.346222:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121569024 00000100:00100000:0.0:1789302432.346225:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121569024 00000100:00100000:0.0:1789302432.346243:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789302432.346248:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121568384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302432.346287:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121568384:12345-0@lo:400:kworker.0 Request processed in 38us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302432.346294:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789302432.346306:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789302432.346312:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121569024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302432.346336:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121569024:12345-0@lo:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302432.346342:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789302432.346359:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302432.346363:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302432.346385:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121568512:0@lo:400:kworker.0 00010000:00080000:0.0:1789302432.346396:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f74e00 x1876219121568384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302432.346406:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121568384:0@lo:400:kworker.0 00010000:00080000:0.0:1789302432.346415:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f75180 x1876219121569024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302432.346422:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121569024:0@lo:400:kworker.0 00000100:00100000:3.0:1789302432.346524:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121568256:0@lo:400:kworker.0 00000100:00100000:2.0:1789302432.346659:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121568640:0@lo:8:kworker.0 00000100:00100000:2.0:1789302432.346692:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302432.346738:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121568640 00000100:00100000:2.0:1789302432.346743:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121568640 00000100:00100000:2.0:1789302432.346765:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302432.346770:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876219121568640:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789302432.346788:0:18618:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1789302432.349077:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f76a00 x1876219121568896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302432.349097:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121568896:0@lo:400:kworker.0 00010000:00080000:3.0:1789302432.349159:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc381f77800 x1876219121568768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302432.349169:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121568768:0@lo:400:kworker.0 00000100:00100000:1.0:1789302432.382035:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876219121568640:12345-0@lo:8:kworker.0 Request processed in 35254us (35332us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789302432.382050:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789302432.382995:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302432.383011:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789302432.383017:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121568640:0@lo:8:kworker.0 00010000:00010000:3.0:1789302433.300254:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302433.366462:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302413/real 1789302413] req@ffff8cc3843ef800 x1876219121558912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302433 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302433.366493:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc3843ef800 x1876219121558912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302433 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302433.366502:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302413/real 1789302413] req@ffff8cc3843ec380 x1876219121559040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302433 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302433.366512:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cc3843ec380 x1876219121559040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302433 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789302433.366530:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4a04cd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789302433.366547:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789302433.366551:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121558912:0@lo:8:kworker.0 00000100:00080000:3.0:1789302433.366557:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc486746000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789302433.366562:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789302433.366594:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121559040:0@lo:8:kworker.0 00000100:00080000:0.0:1789302433.366719:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302433.366724:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789302433.366726:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc4a04cd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302433.366731:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:0.0:1789302433.366737:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789302433.366758:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cc4a04cd000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302433.366777:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc484fe0380 x1876219121569408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789302433.366796:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302433.366799:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789302433.366801:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc486746000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302433.366804:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:0.0:1789302433.366807:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789302433.366812:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cc486746000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302433.366826:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd803b80 x1876219121569536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789302433.366853:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302433.366857:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789302433.366858:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302433.366862:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 508 00000100:00080000:0.0:1789302433.366864:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789302433.366869:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cc4b5138800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302433.366879:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc4bd801880 x1876219121570048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302433.366919:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121569792:0@lo:400:kworker.0 00000100:00100000:0.0:1789302433.366978:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302433.367005:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121570432:0@lo:400:kworker.0 00000100:00100000:0.0:1789302433.367032:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302433.367052:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789302433.367058:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121569152:0@lo:400:kworker.0 00000100:00100000:0.0:1789302433.367084:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302433.367133:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121569920:0@lo:400:kworker.0 00000100:00100000:0.0:1789302433.367158:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302433.367214:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121569664:0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.367243:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302433.367263:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121570304:0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.367280:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302433.367297:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789302433.367302:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121569280:0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.367319:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302433.367333:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121570176:0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.367362:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302433.367390:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121569792 00000100:00100000:3.0:1789302433.367396:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121569792 00000100:00100000:3.0:1789302433.367434:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121569280 00000100:00100000:3.0:1789302433.367437:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121569280 00000100:00100000:3.0:1789302433.367453:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789302433.367461:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121569792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.367507:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121569792:12345-0@lo:400:kworker.0 Request processed in 46us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302433.367514:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789302433.367533:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789302433.367539:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121569280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.367571:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121569280:12345-0@lo:400:kworker.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302433.367576:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789302433.367597:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121569152 00000100:00100000:3.0:1789302433.367600:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121569152 00000100:00100000:3.0:1789302433.367634:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789302433.367640:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:3645:x1876219121569152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.367670:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:3645:x1876219121569152:12345-0@lo:400:kworker.0 Request processed in 31us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302433.367676:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789302433.367703:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121570432 00000100:00100000:3.0:1789302433.367707:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121570432 00000100:00100000:3.0:1789302433.367725:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121569664 00000100:00100000:3.0:1789302433.367728:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121569664 00000100:00100000:3.0:1789302433.367737:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121570304 00000100:00100000:3.0:1789302433.367739:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121570304 00000100:00100000:3.0:1789302433.367748:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121570176 00000100:00100000:3.0:1789302433.367750:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121570176 00000100:00100000:3.0:1789302433.367763:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789302433.367769:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121570432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.367796:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121570432:12345-0@lo:400:kworker.0 Request processed in 28us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302433.367803:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789302433.367815:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789302433.367821:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121569664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.367848:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876219121569664:12345-0@lo:400:kworker.0 Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302433.367853:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789302433.367865:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789302433.367871:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121570304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.367896:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121570304:12345-0@lo:400:kworker.0 Request processed in 26us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302433.367911:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789302433.367924:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789302433.367929:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121570176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.367957:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876219121570176:12345-0@lo:400:kworker.0 Request processed in 28us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302433.367962:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789302433.368010:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121569280:0@lo:400:kworker.0 00010000:00080000:3.0:1789302433.368022:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd802d80 x1876219121570176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302433.368032:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876219121570176:0@lo:400:kworker.0 00010000:00080000:3.0:1789302433.368042:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd803100 x1876219121569664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302433.368049:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876219121569664:0@lo:400:kworker.0 00010000:00080000:3.0:1789302433.368058:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd801f80 x1876219121570304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302433.368065:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121570304:0@lo:400:kworker.0 00000100:00100000:3.0:1789302433.368091:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121569408:0@lo:8:kworker.0 00000100:00100000:0.0:1789302433.375262:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121569792:0@lo:400:kworker.0 00010000:00080000:0.0:1789302433.375282:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd800000 x1876219121570432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302433.375293:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121570432:0@lo:400:kworker.0 00000100:00100000:0.0:1789302433.375316:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121569152:0@lo:400:kworker.0 00000100:00100000:0.0:1789302433.375351:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302433.375874:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121569920 00000100:00100000:1.0:1789302433.375882:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121569920 00000100:00100000:1.0:1789302433.375963:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302433.375982:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121569920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302433.376055:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121569920:12345-0@lo:400:kworker.0 Request processed in 74us (8896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302433.376062:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302433.376865:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121569536:0@lo:8:kworker.0 00000100:00100000:0.0:1789302433.376908:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302433.376937:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121570048:0@lo:8:kworker.0 00000100:00100000:0.0:1789302433.376963:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302433.378705:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121569408 00000100:00100000:2.0:1789302433.378718:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121569408 00000100:00100000:2.0:1789302433.378767:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121569536 00000100:00100000:2.0:1789302433.378770:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121569536 00000100:00100000:2.0:1789302433.378779:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121570048 00000100:00100000:2.0:1789302433.378781:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121570048 00000100:00100000:2.0:1789302433.378796:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302433.378803:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876219121569408:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789302433.378836:0:19064:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:2.0:1789302433.378868:0:19064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd39a6aa 00002000:00100000:2.0:1789302433.378882:0:19064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cc3829c0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789302433.378885:0:19064:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789302433.378888:0:19064:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789302433.378966:0:19064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789302433.378991:0:19064:0:(import.c:65:import_set_state_nolock()) ffff8cc3829c1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302433.379067:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876219121569408:12345-0@lo:8:kworker.0 Request processed in 263us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302433.379090:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302433.379107:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302433.379141:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876219121569536:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789302433.379153:0:19064:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789302433.379196:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876219121569536:12345-0@lo:8:kworker.0 Request processed in 54us (2287us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789302433.379202:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302433.379213:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302433.379217:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876219121570048:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789302433.379226:0:19064:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789302433.379249:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876219121570048:12345-0@lo:8:kworker.0 Request processed in 30us (2284us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789302433.379254:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789302433.380884:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc484fe0380 x1876219121569408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302433.380899:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789302433.380908:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789302433.380916:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789302433.380921:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789302433.380924:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4a04cd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789302433.380942:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789302433.380948:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc484fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121569408:0@lo:8:kworker.0 00000100:00080000:0.0:1789302433.380962:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc486746000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302433.380966:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789302433.380969:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121569536:0@lo:8:kworker.0 00000100:00080000:0.0:1789302433.380998:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302433.381002:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789302433.381005:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121570048:0@lo:8:kworker.0 00010000:00080000:0.0:1789302433.381047:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc4bd803480 x1876219121569920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302433.381058:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4bd803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121569920:0@lo:400:kworker.0 00000004:00080000:2.0:1789302433.381334:0:17135:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1789302433.381424:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302433.381437:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121570560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302433.381495:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302433.381663:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121570560 00000100:00100000:0.0:1789302433.381671:0:18620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121570560 00000100:00100000:0.0:1789302433.381718:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789302433.381727:0:18620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876219121570560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302433.382251:0:18620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789302433.382298:0:18620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876219121570560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 572us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302433.382306:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789302433.382331:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789302433.382448:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc383a2b100 x1876219121570560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302433.382466:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121570560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302433.382622:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17135:1876219121570688:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789302433.382655:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302433.382684:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc488765d80 going to sleep for 11 seconds 00000004:00080000:2.0:1789302433.382702:0:17134:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789302433.382864:0:17134:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 509425750833ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789302433.382870:0:17134:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789302433.384713:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121570688 00000100:00100000:3.0:1789302433.384727:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121570688 00000100:00100000:3.0:1789302433.384940:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789302433.384951:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17135:x1876219121570688:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789302433.389211:0:17090:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789302433.392487:0:18616:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789302433.392498:0:18616:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789302433.392505:0:18616:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:1.0:1789302433.416092:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.416313:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c4c824f/0x1ff82925bd39a6b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.416332:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.416627:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.416636:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c4c824f/0x1ff82925bd39a6b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.416656:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c4c824f/0x1ff82925bd39a6b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.416669:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c4c824f/0x1ff82925bd39a6b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.416678:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c4c824f/0x1ff82925bd39a6b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.416849:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789302433.420654:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.420669:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6edcc32/0x1ff82925bd39a6b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.420687:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.420692:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.420698:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6edcc32/0x1ff82925bd39a6b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.420713:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6edcc32/0x1ff82925bd39a6b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.420724:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6edcc32/0x1ff82925bd39a6b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.420733:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6edcc32/0x1ff82925bd39a6b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.422675:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302433.422686:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c4c824f/0x1ff82925bd39a6b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.422715:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa400 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302433.422720:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c4c824f/0x1ff82925bd39a6b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.422731:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c4c824f/0x1ff82925bd39a6b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.422756:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c4c824f/0x1ff82925bd39a6b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.422764:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c4c824f/0x1ff82925bd39a6b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.422785:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302433.422788:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6edcc32/0x1ff82925bd39a6b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.422794:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab200 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302433.422798:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6edcc32/0x1ff82925bd39a6b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.422804:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6edcc32/0x1ff82925bd39a6b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.422814:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6edcc32/0x1ff82925bd39a6b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.422827:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302433.422829:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302433.422831:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.424481:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789302433.424495:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6edcc32/0x1ff82925bd39a6b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789302433.425927:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.425937:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002be971de/0x1ff82925bd39a6bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.425960:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.425965:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.425972:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002be971de/0x1ff82925bd39a6bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.425987:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002be971de/0x1ff82925bd39a6bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.425998:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002be971de/0x1ff82925bd39a6bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.426006:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002be971de/0x1ff82925bd39a6bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.426721:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302433.426731:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002be971de/0x1ff82925bd39a6bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.426742:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302433.426746:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002be971de/0x1ff82925bd39a6bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.426756:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002be971de/0x1ff82925bd39a6bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.426773:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002be971de/0x1ff82925bd39a6bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.426955:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789302433.426961:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002be971de/0x1ff82925bd39a6bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789302433.428351:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.428362:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005816f66c/0x1ff82925bd39a6c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.428375:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.428379:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.428385:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005816f66c/0x1ff82925bd39a6c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.428414:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005816f66c/0x1ff82925bd39a6c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.428424:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005816f66c/0x1ff82925bd39a6c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.428432:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005816f66c/0x1ff82925bd39a6c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.428486:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302433.428498:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005816f66c/0x1ff82925bd39a6c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.428506:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302433.428510:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005816f66c/0x1ff82925bd39a6c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.428534:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005816f66c/0x1ff82925bd39a6c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.428551:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005816f66c/0x1ff82925bd39a6c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.428560:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.428562:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302433.428992:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.429073:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789302433.429085:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005816f66c/0x1ff82925bd39a6c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789302433.429855:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.429875:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ca3f13/0x1ff82925bd39a6cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.429886:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.429890:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.429896:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053ca3f13/0x1ff82925bd39a6cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.429907:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053ca3f13/0x1ff82925bd39a6cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.429928:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ca3f13/0x1ff82925bd39a6cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.429936:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053ca3f13/0x1ff82925bd39a6cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.429945:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302433.430136:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302433.430142:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053ca3f13/0x1ff82925bd39a6cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.430150:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab600 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302433.430155:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ca3f13/0x1ff82925bd39a6cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.430164:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ca3f13/0x1ff82925bd39a6cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.430187:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053ca3f13/0x1ff82925bd39a6cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.430201:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053ca3f13/0x1ff82925bd39a6cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.430219:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.430221:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.430223:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789302433.430702:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.430710:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d023b209/0x1ff82925bd39a6d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.430720:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.430723:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.430727:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d023b209/0x1ff82925bd39a6d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.430738:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d023b209/0x1ff82925bd39a6d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.430746:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d023b209/0x1ff82925bd39a6d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.430755:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d023b209/0x1ff82925bd39a6d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.430787:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302433.431455:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302433.431461:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d023b209/0x1ff82925bd39a6d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.431471:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab000 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302433.431475:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d023b209/0x1ff82925bd39a6d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.431485:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d023b209/0x1ff82925bd39a6d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.431499:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d023b209/0x1ff82925bd39a6d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.431507:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d023b209/0x1ff82925bd39a6d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.431638:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.431640:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.431642:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789302433.431811:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.431817:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009285074e/0x1ff82925bd39a6db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.431827:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.431831:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.431835:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009285074e/0x1ff82925bd39a6db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.431846:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009285074e/0x1ff82925bd39a6db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.431854:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009285074e/0x1ff82925bd39a6db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.431872:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009285074e/0x1ff82925bd39a6db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.431890:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302433.432025:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302433.432030:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009285074e/0x1ff82925bd39a6db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.432038:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa200 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302433.432041:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009285074e/0x1ff82925bd39a6db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.432049:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009285074e/0x1ff82925bd39a6db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.432060:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009285074e/0x1ff82925bd39a6db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.432067:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009285074e/0x1ff82925bd39a6db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.432082:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.432095:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.432097:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789302433.432652:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.432659:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e8a57b/0x1ff82925bd39a6e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.432669:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.432679:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.432685:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066e8a57b/0x1ff82925bd39a6e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.432695:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066e8a57b/0x1ff82925bd39a6e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.432704:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066e8a57b/0x1ff82925bd39a6e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.432711:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066e8a57b/0x1ff82925bd39a6e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.432727:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302433.433244:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302433.433250:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066e8a57b/0x1ff82925bd39a6e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.433258:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab400 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302433.433262:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e8a57b/0x1ff82925bd39a6e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.433285:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066e8a57b/0x1ff82925bd39a6e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.433299:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066e8a57b/0x1ff82925bd39a6e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.433306:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066e8a57b/0x1ff82925bd39a6e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.433324:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.433326:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.433328:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789302433.433775:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.433782:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd39a6e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.433792:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.433796:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.433801:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd39a6e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.433812:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd39a6e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.433820:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd39a6e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.433833:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd39a6e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.433854:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789302433.434281:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.434288:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562b7be4/0x1ff82925bd39a6f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.434297:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.434300:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.434305:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562b7be4/0x1ff82925bd39a6f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.434314:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562b7be4/0x1ff82925bd39a6f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.434323:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562b7be4/0x1ff82925bd39a6f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.434331:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000562b7be4/0x1ff82925bd39a6f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.434351:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789302433.434944:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.434951:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaec84b7/0x1ff82925bd39a6f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.434966:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.434970:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.434975:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaec84b7/0x1ff82925bd39a6f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.434985:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaec84b7/0x1ff82925bd39a6f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.434993:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaec84b7/0x1ff82925bd39a6f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.435000:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaec84b7/0x1ff82925bd39a6f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.435010:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789302433.435468:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789302433.435475:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aefa71c/0x1ff82925bd39a6fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.435484:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=509s v=(0 0) 00010000:00010000:1.0:1789302433.435488:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302433.435492:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008aefa71c/0x1ff82925bd39a6fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.435502:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008aefa71c/0x1ff82925bd39a6fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.435635:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aefa71c/0x1ff82925bd39a6fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.435644:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008aefa71c/0x1ff82925bd39a6fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.435653:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789302433.435871:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789302433.435879:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd39a6e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.435888:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aaa00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302433.435893:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd39a6e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.435902:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd39a6e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.435917:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd39a6e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.435939:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079350a5e/0x1ff82925bd39a6e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.435959:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789302433.435963:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000562b7be4/0x1ff82925bd39a6f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.435970:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166e000 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302433.435973:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000562b7be4/0x1ff82925bd39a6f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.435981:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000562b7be4/0x1ff82925bd39a6f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.435991:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000562b7be4/0x1ff82925bd39a6f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.435999:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562b7be4/0x1ff82925bd39a6f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.436012:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302433.436015:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaec84b7/0x1ff82925bd39a6f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.436021:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166e400 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302433.436029:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaec84b7/0x1ff82925bd39a6f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.436038:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaec84b7/0x1ff82925bd39a6f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.436047:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaec84b7/0x1ff82925bd39a6f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.436055:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaec84b7/0x1ff82925bd39a6f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.436067:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302433.436070:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008aefa71c/0x1ff82925bd39a6fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.436076:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166ec00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302433.436079:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008aefa71c/0x1ff82925bd39a6fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.436096:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008aefa71c/0x1ff82925bd39a6fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.436106:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008aefa71c/0x1ff82925bd39a6fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.436133:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008aefa71c/0x1ff82925bd39a6fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.436154:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.436156:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.436158:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302433.436472:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302433.436909:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.436918:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a705 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.436929:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.436932:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.436938:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.436962:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.436971:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.436979:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.436999:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302433.437707:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.437715:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000428ff42a/0x1ff82925bd39a70c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.437726:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.437729:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.437734:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000428ff42a/0x1ff82925bd39a70c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.437744:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000428ff42a/0x1ff82925bd39a70c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.437752:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000428ff42a/0x1ff82925bd39a70c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.437772:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000428ff42a/0x1ff82925bd39a70c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.437890:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789302433.438850:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.438868:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abae62f4/0x1ff82925bd39a713 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.438882:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.438886:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.438891:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abae62f4/0x1ff82925bd39a713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.438903:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abae62f4/0x1ff82925bd39a713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.438912:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abae62f4/0x1ff82925bd39a713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.438920:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abae62f4/0x1ff82925bd39a713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439466:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789302433.439475:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439484:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311de00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302433.439489:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439633:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a705 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439656:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a705 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439664:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039f2b801/0x1ff82925bd39a705 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439687:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302433.439691:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000428ff42a/0x1ff82925bd39a70c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439698:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311c200 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302433.439713:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000428ff42a/0x1ff82925bd39a70c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439722:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000428ff42a/0x1ff82925bd39a70c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439732:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000428ff42a/0x1ff82925bd39a70c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439739:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000428ff42a/0x1ff82925bd39a70c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439765:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302433.439769:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abae62f4/0x1ff82925bd39a713 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439775:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311ce00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302433.439778:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abae62f4/0x1ff82925bd39a713 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439785:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abae62f4/0x1ff82925bd39a713 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439795:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abae62f4/0x1ff82925bd39a713 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.439802:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302433.439804:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302433.439806:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.440069:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302433.440438:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302433.440446:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abae62f4/0x1ff82925bd39a713 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302433.441021:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.441029:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000547ab13d/0x1ff82925bd39a71a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.441041:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.441045:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.441050:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000547ab13d/0x1ff82925bd39a71a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.441064:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000547ab13d/0x1ff82925bd39a71a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.441073:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000547ab13d/0x1ff82925bd39a71a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.441081:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000547ab13d/0x1ff82925bd39a71a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.441424:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302433.441432:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000547ab13d/0x1ff82925bd39a71a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.441440:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311c000 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302433.441444:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000547ab13d/0x1ff82925bd39a71a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.441468:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000547ab13d/0x1ff82925bd39a71a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302433.441483:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000547ab13d/0x1ff82925bd39a71a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.441721:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302433.441727:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000547ab13d/0x1ff82925bd39a71a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302433.442155:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.442162:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac60ea8d/0x1ff82925bd39a721 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.442196:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.442200:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.442205:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac60ea8d/0x1ff82925bd39a721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.442217:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac60ea8d/0x1ff82925bd39a721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.442227:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac60ea8d/0x1ff82925bd39a721 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.442235:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac60ea8d/0x1ff82925bd39a721 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.442345:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302433.442351:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac60ea8d/0x1ff82925bd39a721 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.442360:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311c800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302433.442363:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac60ea8d/0x1ff82925bd39a721 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.442372:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac60ea8d/0x1ff82925bd39a721 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.442383:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac60ea8d/0x1ff82925bd39a721 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.442392:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.442394:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.442677:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302433.442788:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302433.442794:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac60ea8d/0x1ff82925bd39a721 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302433.442937:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302433.443413:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.443420:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b460f60/0x1ff82925bd39a728 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.443431:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.443435:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.443440:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b460f60/0x1ff82925bd39a728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.443462:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b460f60/0x1ff82925bd39a728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.443471:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b460f60/0x1ff82925bd39a728 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.443479:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b460f60/0x1ff82925bd39a728 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.443652:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302433.443933:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302433.443940:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b460f60/0x1ff82925bd39a728 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.443956:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311da00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302433.443960:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b460f60/0x1ff82925bd39a728 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.443969:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b460f60/0x1ff82925bd39a728 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.443985:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b460f60/0x1ff82925bd39a728 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.443992:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b460f60/0x1ff82925bd39a728 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.444012:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.444014:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.444016:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302433.444102:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.444108:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004378f1f1/0x1ff82925bd39a72f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.444149:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.444153:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.444158:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004378f1f1/0x1ff82925bd39a72f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.444169:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004378f1f1/0x1ff82925bd39a72f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.444186:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004378f1f1/0x1ff82925bd39a72f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.444206:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004378f1f1/0x1ff82925bd39a72f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.444220:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302433.444561:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302433.444566:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004378f1f1/0x1ff82925bd39a72f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.444574:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538ec00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302433.444578:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004378f1f1/0x1ff82925bd39a72f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.444587:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004378f1f1/0x1ff82925bd39a72f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.444606:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004378f1f1/0x1ff82925bd39a72f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.444614:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004378f1f1/0x1ff82925bd39a72f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.444630:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.444631:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.444633:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302433.445001:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.445007:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000020fc83e/0x1ff82925bd39a736 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.445017:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.445021:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.445027:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000020fc83e/0x1ff82925bd39a736 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.445036:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000020fc83e/0x1ff82925bd39a736 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.445045:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000020fc83e/0x1ff82925bd39a736 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.445051:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000020fc83e/0x1ff82925bd39a736 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.445069:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302433.445644:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.445651:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf136b5a/0x1ff82925bd39a73d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.445667:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.445671:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.445676:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf136b5a/0x1ff82925bd39a73d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.445686:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf136b5a/0x1ff82925bd39a73d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.445695:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf136b5a/0x1ff82925bd39a73d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.445702:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf136b5a/0x1ff82925bd39a73d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.445710:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789302433.446057:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.446063:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096a7644e/0x1ff82925bd39a744 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.446072:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.446075:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.446079:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096a7644e/0x1ff82925bd39a744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.446088:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096a7644e/0x1ff82925bd39a744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.446109:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096a7644e/0x1ff82925bd39a744 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.446146:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096a7644e/0x1ff82925bd39a744 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.446156:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789302433.446758:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.446765:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd49bbd/0x1ff82925bd39a74b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.446774:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.446777:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.446781:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cd49bbd/0x1ff82925bd39a74b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.446790:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cd49bbd/0x1ff82925bd39a74b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.446798:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd49bbd/0x1ff82925bd39a74b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.446805:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cd49bbd/0x1ff82925bd39a74b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.446827:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789302433.447148:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789302433.447155:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000020fc83e/0x1ff82925bd39a736 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447164:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538e600 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302433.447168:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000020fc83e/0x1ff82925bd39a736 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447186:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000020fc83e/0x1ff82925bd39a736 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447203:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000020fc83e/0x1ff82925bd39a736 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447210:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000020fc83e/0x1ff82925bd39a736 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447241:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789302433.447245:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf136b5a/0x1ff82925bd39a73d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447252:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f600 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302433.447255:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf136b5a/0x1ff82925bd39a73d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447263:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf136b5a/0x1ff82925bd39a73d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447273:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf136b5a/0x1ff82925bd39a73d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447280:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf136b5a/0x1ff82925bd39a73d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447292:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302433.447295:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096a7644e/0x1ff82925bd39a744 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447302:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538e800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302433.447305:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096a7644e/0x1ff82925bd39a744 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447325:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096a7644e/0x1ff82925bd39a744 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447449:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096a7644e/0x1ff82925bd39a744 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447458:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096a7644e/0x1ff82925bd39a744 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447474:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302433.447477:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cd49bbd/0x1ff82925bd39a74b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447485:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302433.447488:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd49bbd/0x1ff82925bd39a74b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447496:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd49bbd/0x1ff82925bd39a74b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447507:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cd49bbd/0x1ff82925bd39a74b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447514:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cd49bbd/0x1ff82925bd39a74b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.447660:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.447662:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.447664:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302433.447778:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.449074:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac041053/0x1ff82925bd39a752 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.449088:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.449092:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.449098:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac041053/0x1ff82925bd39a752 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.449136:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac041053/0x1ff82925bd39a752 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.449148:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac041053/0x1ff82925bd39a752 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.449156:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac041053/0x1ff82925bd39a752 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.449185:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302433.449497:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302433.449505:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac041053/0x1ff82925bd39a752 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.449514:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538ee00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302433.449637:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac041053/0x1ff82925bd39a752 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.449649:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac041053/0x1ff82925bd39a752 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.449666:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac041053/0x1ff82925bd39a752 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.449674:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac041053/0x1ff82925bd39a752 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.449695:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.449697:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.449698:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302433.450021:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.450028:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cf66ec/0x1ff82925bd39a759 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.450037:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.450049:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.450053:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020cf66ec/0x1ff82925bd39a759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.450064:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020cf66ec/0x1ff82925bd39a759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.450074:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cf66ec/0x1ff82925bd39a759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.450081:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020cf66ec/0x1ff82925bd39a759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.450161:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302433.450649:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302433.450655:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020cf66ec/0x1ff82925bd39a759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.450679:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538e200 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302433.450683:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cf66ec/0x1ff82925bd39a759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.450692:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cf66ec/0x1ff82925bd39a759 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.450705:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020cf66ec/0x1ff82925bd39a759 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.450713:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020cf66ec/0x1ff82925bd39a759 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.450730:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.450732:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.450734:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302433.450818:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.450823:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d426683/0x1ff82925bd39a760 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.450831:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.450835:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.450839:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d426683/0x1ff82925bd39a760 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.450848:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d426683/0x1ff82925bd39a760 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.450867:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d426683/0x1ff82925bd39a760 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.450882:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d426683/0x1ff82925bd39a760 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.450900:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302433.451266:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302433.451271:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef50c36c/0x1ff82925bd39a767 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.451280:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=509s v=(0 0) 00010000:00010000:0.0:1789302433.451283:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302433.451287:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef50c36c/0x1ff82925bd39a767 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.451296:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef50c36c/0x1ff82925bd39a767 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.451304:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef50c36c/0x1ff82925bd39a767 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.451311:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef50c36c/0x1ff82925bd39a767 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302433.451320:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1789302433.451362:0:18616:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1789302433.451455:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17135:x1876219121570688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 66503us (68795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302433.451470:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789302433.451741:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17135:1876219121570688:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789302433.451757:0:17135:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789302433.451802:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17135:1876219121570816:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789302433.451838:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302433.451879:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc488765d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302433.451923:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121570816 00000100:00100000:0.0:1789302433.451930:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121570816 00010000:00010000:1.0:1789302433.452024:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302433.452031:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d426683/0x1ff82925bd39a760 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.452051:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538fc00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302433.452055:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d426683/0x1ff82925bd39a760 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.452065:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d426683/0x1ff82925bd39a760 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.452087:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d426683/0x1ff82925bd39a760 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.452094:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d426683/0x1ff82925bd39a760 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.452123:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302433.452127:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef50c36c/0x1ff82925bd39a767 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.452133:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538e000 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302433.452136:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef50c36c/0x1ff82925bd39a767 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.452143:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef50c36c/0x1ff82925bd39a767 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.452153:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef50c36c/0x1ff82925bd39a767 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.452161:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef50c36c/0x1ff82925bd39a767 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302433.452186:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.452188:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302433.452194:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302433.452238:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302433.452248:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17135:x1876219121570816:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789302433.452282:0:18618:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1789302433.455955:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789302433.474323:0:18613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1789302433.474370:0:18613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789302433.474786:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17135:x1876219121570816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22536us (22943us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789302433.474797:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302433.474899:0:17135:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789302433.474908:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17135:1876219121570816:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789302433.474923:0:17135:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:1.0:1789302433.879531:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121570944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302433.879596:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302433.879652:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121570944 00000100:00100000:1.0:1789302433.879660:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121570944 00000100:00100000:1.0:1789302433.879701:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789302433.879709:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121570944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789302433.879739:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789302433.879779:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121570944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302433.879785:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789302433.879827:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121570944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302433.880058:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121571072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302433.880214:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302433.882013:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121571072 00000100:00100000:0.0:1789302433.882024:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121571072 00000100:00100000:0.0:1789302433.882256:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789302433.882268:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121571072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789302433.882300:0:17116:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789302433.882672:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121571072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 406us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302433.882679:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789302433.882753:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121571072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789302434.325264:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302434.654577:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1789302435.010581:0:19429:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789302435.010584:0:19429:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789302435.010586:0:19429:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789302435.010694:0:19429:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cc3829c5800 00000020:01000004:2.0:1789302435.010708:0:19429:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789302435.010722:0:19429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789302435.010735:0:19429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cc4ac2a8000) 00000020:00000080:2.0:1789302435.010752:0:19429:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789302435.049884:0:19429:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789302435.055826:0:19429:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789302435.056910:0:19429:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789302435.057801:0:19429:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789302435.058360:0:19429:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789302435.058953:0:19429:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789302435.059397:0:19429:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1789302435.061683:0:19429:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789302435.061959:0:19429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789302435.061975:0:19429:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789302435.061988:0:19429:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1ff82925bd39a775 00000020:01000004:1.0:1789302435.061995:0:19429:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789302435.062019:0:19429:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.109@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789302435.062022:0:19429:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789302435.062028:0:19429:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789302435.062058:0:19429:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789302435.062062:0:19429:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789302435.074919:0:19429:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789302435.074962:0:19429:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.109@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789302435.074967:0:19429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789302435.074969:0:19429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789302435.074971:0:19429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302435.074972:0:19429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302435.074973:0:19429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302435.074974:0:19429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302435.074981:0:19429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302435.074983:0:19429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302435.074984:0:19429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789302435.074988:0:19429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789302435.074990:0:19429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302435.074991:0:19429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789302435.074992:0:19429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302435.074993:0:19429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302435.074994:0:19429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302435.074995:0:19429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302435.074996:0:19429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302435.074997:0:19429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302435.074998:0:19429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789302435.075024:0:19429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789302435.075043:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571200:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789302435.075149:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.075193:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484ed2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302435.075256:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121571200 00000100:00100000:0.0:1789302435.075265:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121571200 00000100:00100000:0.0:1789302435.075319:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789302435.075328:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:19429:x1876219121571200:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789302435.075357:0:17102:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789302435.075361:0:17102:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789302435.075364:0:17102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789302435.075690:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:19429:x1876219121571200:12345-0@lo:253:mount.lustre.0 Request processed in 362us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302435.075710:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789302435.075791:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571200:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789302435.075801:0:19429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789302435.075804:0:19429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789302435.075805:0:19429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789302435.075806:0:19429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302435.075807:0:19429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302435.075808:0:19429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302435.075809:0:19429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302435.075810:0:19429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302435.075811:0:19429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302435.075812:0:19429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789302435.075828:0:19429:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cc3829c5800 from lustre-OST0001 10000000:01000000:2.0:1789302435.075861:0:19429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789302435.075865:0:19429:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789302435.075872:0:19429:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cc4bd978000 local copy 00010000:00010000:2.0:1789302435.075881:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302435.075975:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302435.076008:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.076035:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0031780 going to sleep for 11 seconds 00000100:00100000:0.0:1789302435.076135:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121571328 00000100:00100000:0.0:1789302435.076141:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121571328 00000100:00100000:0.0:1789302435.076184:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789302435.076191:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:19429:x1876219121571328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302435.076256:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:19429:x1876219121571328:12345-0@lo:501:mount.lustre.0 Request processed in 64us (247us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302435.076263:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789302435.076425:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571328:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789302435.076437:0:19429:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789302435.076455:0:19429:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789302435.076461:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.076470:0:19429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc3839aa000/0x1ff82925bd39a3cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a3d2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302435.076494:0:19429:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cc3829c5800 10000000:01000000:2.0:1789302435.076499:0:19429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789302435.076503:0:19429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789302435.076567:0:19429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789302435.076572:0:19429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789302435.076575:0:19429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789302435.076595:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348800/0x1ff82925bd39a77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.076602:0:19429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348800/0x1ff82925bd39a77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.076611:0:19429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348800/0x1ff82925bd39a77c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302435.076623:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789302435.076647:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.076760:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0031780 going to sleep for 11 seconds 00000100:00100000:0.0:1789302435.078420:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121571456 00000100:00100000:0.0:1789302435.078433:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121571456 00000100:00100000:0.0:1789302435.078485:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789302435.078494:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:19429:x1876219121571456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302435.078508:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302435.078526:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd39a783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a77c expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302435.078552:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd39a783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a77c expref: 22 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302435.078563:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538e400/0x1ff82925bd39a783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a77c expref: 22 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302435.078571:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538e400, rc 0) 00000100:00100000:0.0:1789302435.078686:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:19429:x1876219121571456:12345-0@lo:101:mount.lustre.0 Request processed in 192us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302435.078692:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789302435.083640:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302435.083672:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348800/0x1ff82925bd39a77c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a783 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.083684:0:19429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348800/0x1ff82925bd39a77c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a783 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302435.085742:0:19429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789302435.086874:0:19429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302435.092844:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789302435.092971:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789302435.092989:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789302435.093002:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789302435.093014:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789302435.093026:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789302435.093049:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789302435.093054:0:19429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789302435.093312:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302435.093374:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302435.093440:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121571584 00000100:00100000:0.0:1789302435.093455:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121571584 00000100:00100000:2.0:1789302435.093731:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0031900 going to sleep for 11 seconds 00000100:00100000:0.0:1789302435.093798:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789302435.093809:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc49921ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:19429:x1876219121571584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302435.094022:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc49921ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:19429:x1876219121571584:12345-0@lo:501:mount.lustre.0 Request processed in 215us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302435.094030:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789302435.094095:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302435.095366:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571712:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302435.096106:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.096199:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0031900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302435.096492:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121571712 00000100:00100000:3.0:1789302435.096501:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121571712 00000100:00100000:3.0:1789302435.096619:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789302435.096629:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc49921b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:19429:x1876219121571712:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789302435.097406:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc49921b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:19429:x1876219121571712:12345-0@lo:503:mount.lustre.0 Request processed in 777us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302435.097584:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789302435.097734:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000040:00080000:3.0:1789302435.099487:0:19429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789302435.099595:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302435.099677:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302435.099720:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0ab0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789302435.099865:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121571840 00000100:00100000:1.0:1789302435.099873:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121571840 00000100:00100000:1.0:1789302435.099921:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789302435.099930:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc49921b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:19429:x1876219121571840:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302435.100603:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc49921b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:19429:x1876219121571840:12345-0@lo:502:mount.lustre.0 Request processed in 672us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.100611:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789302435.100775:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789302435.101027:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789302435.101059:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789302435.101075:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789302435.101089:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789302435.101101:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789302435.101324:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789302435.101344:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789302435.101374:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789302435.101395:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789302435.101425:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302435.101469:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302435.101498:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0ab0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789302435.101565:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121571968 00000100:00100000:0.0:1789302435.101572:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121571968 00000100:00100000:0.0:1789302435.101616:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789302435.101624:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc499219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:19429:x1876219121571968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789302435.101979:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc499219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:19429:x1876219121571968:12345-0@lo:502:mount.lustre.0 Request processed in 354us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302435.101987:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789302435.102964:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121571968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789302435.103042:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789302435.103053:0:19429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789302435.104649:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789302435.104733:0:19433:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789302435.104740:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302435.104742:0:19433:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789302435.104749:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789302435.104764:0:19433:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cc381fc19c0) 00000020:00000080:1.0:1789302435.104787:0:19433:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789302435.104792:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789302435.104921:0:19433:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc3829c5800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789302435.104930:0:19433:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789302435.104946:0:19433:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1ff82925bd39a791 00010000:00010000:1.0:1789302435.111812:0:19433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1789302435.112601:0:19433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1789302435.117974:0:19433:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789302435.119475:0:19433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789302435.119488:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302435.119494:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302435.119496:0:19433:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789302435.119500:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302435.119504:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302435.119505:0:19433:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789302435.119508:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789302435.119510:0:19433:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789302435.119513:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302435.119515:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302435.119516:0:19433:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789302435.119519:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302435.119521:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302435.119522:0:19433:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789302435.119525:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789302435.119555:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302435.119558:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302435.119559:0:19433:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789302435.119562:0:19433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789302435.119881:0:19429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789302435.119911:0:19429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789302435.119935:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348800/0x1ff82925bd39a77c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a783 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302435.119946:0:19429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348800/0x1ff82925bd39a77c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a783 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302435.119954:0:19429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc3829c5800 from 1 10000000:01000000:3.0:1789302435.119956:0:19429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789302435.119992:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302435.120000:0:19429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302435.120010:0:19429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302435.120033:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572096:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789302435.120096:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302435.120156:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0ab0780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302435.120381:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121572096 00000100:00100000:1.0:1789302435.120390:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121572096 00000100:00100000:1.0:1789302435.120529:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789302435.120539:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc499219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:19429:x1876219121572096:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302435.120553:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302435.120565:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a79f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a798 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302435.120600:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a79f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a798 expref: 23 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302435.120610:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a79f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a798 expref: 23 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302435.120619:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f800, rc 0) 00000100:00100000:1.0:1789302435.120672:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc499219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:19429:x1876219121572096:12345-0@lo:101:mount.lustre.0 Request processed in 135us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.120681:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789302435.125861:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572096:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302435.125891:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302435.125904:0:19429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302435.127434:0:19429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789302435.127716:0:19429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302435.127894:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789302435.127919:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789302435.127936:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789302435.127942:0:19429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789302435.128006:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302435.128072:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302435.128148:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0ab0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302435.128405:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121572224 00000100:00100000:2.0:1789302435.128415:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121572224 00000100:00100000:2.0:1789302435.128472:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789302435.128482:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc483dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:19429:x1876219121572224:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302435.128586:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc483dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:19429:x1876219121572224:12345-0@lo:501:mount.lustre.0 Request processed in 106us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302435.128593:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789302435.128637:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302435.128679:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572352:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302435.128716:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.128736:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0031240 going to sleep for 11 seconds 00000100:00100000:2.0:1789302435.128749:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121572352 00000100:00100000:2.0:1789302435.128753:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121572352 00000100:00100000:2.0:1789302435.128775:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789302435.128782:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc483dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:19429:x1876219121572352:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302435.128868:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc483dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:19429:x1876219121572352:12345-0@lo:503:mount.lustre.0 Request processed in 86us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302435.128874:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789302435.128916:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572352:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789302435.129411:0:19429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789302435.129474:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302435.129515:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.129541:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0031240 going to sleep for 11 seconds 00000100:00100000:2.0:1789302435.129557:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121572480 00000100:00100000:2.0:1789302435.129561:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121572480 00000100:00100000:2.0:1789302435.129587:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789302435.129595:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc483daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:19429:x1876219121572480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302435.129679:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc483daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:19429:x1876219121572480:12345-0@lo:502:mount.lustre.0 Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302435.129686:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789302435.129731:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572480:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302435.131607:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789302435.131721:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789302435.131739:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789302435.131752:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789302435.131764:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789302435.131776:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789302435.131788:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789302435.131815:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789302435.131830:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789302435.131859:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789302435.131874:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789302435.131918:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572608:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302435.131984:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.132028:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7f24840 going to sleep for 11 seconds 00000100:00100000:3.0:1789302435.133624:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121572608 00000100:00100000:3.0:1789302435.133637:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121572608 00000100:00100000:3.0:1789302435.133707:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789302435.133716:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:19429:x1876219121572608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302435.133869:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:19429:x1876219121572608:12345-0@lo:502:mount.lustre.0 Request processed in 153us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302435.133876:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789302435.135029:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572608:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302435.135332:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789302435.135346:0:19429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789302435.136177:0:19437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302435.136188:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302435.136190:0:19437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789302435.136197:0:19437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc3829c5800 00000020:00000080:2.0:1789302435.136199:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789302435.136217:0:19437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302435.136220:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302435.136228:0:19437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789302435.136231:0:19437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302435.136234:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302435.136236:0:19437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789302435.136239:0:19437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cc3829c5800 00000020:00000080:2.0:1789302435.136241:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789302435.136293:0:19437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302435.136297:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302435.136299:0:19437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789302435.136301:0:19437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302435.136304:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302435.136305:0:19437:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789302435.136309:0:19437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc3829c5800 00000020:00000080:2.0:1789302435.136311:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789302435.136328:0:19437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302435.136331:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302435.136333:0:19437:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789302435.136335:0:19437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302435.136338:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302435.136339:0:19437:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789302435.136342:0:19437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cc3829c5800 00000020:00000080:2.0:1789302435.136344:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789302435.136365:0:19437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302435.136368:0:19437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302435.136370:0:19437:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789302435.136373:0:19437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789302435.136560:0:19429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789302435.136584:0:19429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302435.136608:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302435.136620:0:19429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302435.136682:0:19429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789302435.136685:0:19429:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cc3829c5800 10000000:01000000:1.0:1789302435.136689:0:19429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cc3829c5800 10000000:01000000:1.0:1789302435.136693:0:19429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789302435.136698:0:19429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cc3829c5800 from 1 10000000:01000000:1.0:1789302435.136701:0:19429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789302435.136735:0:19429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd39a7a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302435.136744:0:19429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd39a7a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302435.136767:0:19429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd39a7a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302435.136790:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789302435.136863:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.136902:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484efae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302435.136927:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121572736 00000100:00100000:1.0:1789302435.136933:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121572736 00000100:00100000:1.0:1789302435.136975:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789302435.136984:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:19429:x1876219121572736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302435.136996:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302435.137008:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166f200/0x1ff82925bd39a7ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a7a6 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302435.137031:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166f200/0x1ff82925bd39a7ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a7a6 expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302435.137042:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166f200/0x1ff82925bd39a7ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a7a6 expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302435.137050:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f200, rc 0) 00000100:00100000:1.0:1789302435.137086:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121572736:12345-0@lo:101:mount.lustre.0 Request processed in 103us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.137093:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789302435.137175:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302435.137189:0:19429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd39a7a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a7ad expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302435.137397:0:19429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd39a7a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a7ad expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789302435.141412:0:19429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1789302435.141717:0:19429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302435.142687:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789302435.142721:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789302435.142736:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789302435.142748:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789302435.142761:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789302435.142774:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789302435.142789:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789302435.142817:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789302435.142833:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789302435.142859:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789302435.142876:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789302435.142889:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789302435.142903:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789302435.142917:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789302435.142929:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789302435.142941:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789302435.142955:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789302435.142968:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789302435.142980:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789302435.142992:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789302435.143004:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789302435.143016:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789302435.143026:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789302435.143053:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789302435.143069:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789302435.143082:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789302435.143107:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789302435.143141:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789302435.143153:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789302435.143176:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789302435.143192:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789302435.143215:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789302435.143230:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789302435.143242:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789302435.143255:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789302435.143268:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789302435.143282:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789302435.143295:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789302435.143307:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1789302435.143335:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1789302435.143348:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1789302435.143360:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1789302435.143372:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1789302435.143385:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1789302435.143397:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1789302435.143410:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1789302435.143432:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1789302435.143438:0:19429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1789302435.143542:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302435.143605:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.143649:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121572864 00000100:00100000:1.0:1789302435.143655:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121572864 00000100:00100000:1.0:1789302435.143698:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789302435.143706:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121572864:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302435.143817:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121572864:12345-0@lo:501:mount.lustre.0 Request processed in 110us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.143833:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789302435.143877:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a333c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302435.143898:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302435.143928:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302435.143966:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.143987:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121572992 00000100:00100000:1.0:1789302435.143991:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121572992 00000100:00100000:1.0:1789302435.144013:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789302435.144019:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121572992:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302435.144087:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121572992:12345-0@lo:503:mount.lustre.0 Request processed in 67us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.144093:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789302435.144144:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc382a333c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302435.144156:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121572992:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789302435.147791:0:19429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789302435.147992:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121573120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302435.148069:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.148144:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121573120 00000100:00100000:1.0:1789302435.148151:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121573120 00000100:00100000:1.0:1789302435.148273:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789302435.148283:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121573120:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302435.148389:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121573120:12345-0@lo:502:mount.lustre.0 Request processed in 107us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.148397:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789302435.149641:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302435.149681:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121573120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789302435.149973:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789302435.150005:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789302435.150021:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789302435.150035:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789302435.150049:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789302435.150062:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789302435.150092:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789302435.150108:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789302435.150760:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789302435.150777:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789302435.150791:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789302435.150804:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789302435.150817:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789302435.150831:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789302435.150843:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789302435.150869:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789302435.150882:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789302435.150894:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789302435.150907:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789302435.150918:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789302435.150930:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789302435.150944:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789302435.150973:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789302435.150989:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789302435.151001:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789302435.151012:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789302435.151024:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789302435.151035:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789302435.151047:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789302435.151059:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789302435.151080:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789302435.151094:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789302435.151107:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789302435.151137:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789302435.151151:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789302435.151174:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789302435.151189:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789302435.151389:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789302435.151431:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789302435.151447:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789302435.151461:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789302435.151475:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789302435.151488:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789302435.151501:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789302435.151515:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789302435.151528:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789302435.151543:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789302435.151555:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789302435.151604:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121573248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302435.151691:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.151744:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121573248 00000100:00100000:1.0:1789302435.151752:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121573248 00000100:00100000:1.0:1789302435.151796:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789302435.151804:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121573248:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302435.151917:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121573248:12345-0@lo:502:mount.lustre.0 Request processed in 112us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.151925:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789302435.151973:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302435.151992:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121573248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789302435.152185:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789302435.152961:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789302435.152994:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121573376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302435.153038:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.153067:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121573376 00000100:00100000:1.0:1789302435.153072:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121573376 00000100:00100000:1.0:1789302435.153102:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789302435.153109:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121573376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302435.154543:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121573376:12345-0@lo:502:mount.lustre.0 Request processed in 1430us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.154554:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789302435.154610:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc49011a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302435.154630:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121573376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789302435.155336:0:19429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789302435.155349:0:19429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789302435.180974:0:19442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789302435.180995:0:19442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cc4ac2acd40) 00000020:00000080:2.0:1789302435.181024:0:19442:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789302435.181106:0:19442:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc3829c5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789302435.181130:0:19442:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc3829c5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789302435.181132:0:19442:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc3829c5800 3 00010000:00080000:2.0:1789302435.181172:0:19442:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc4b7e9b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.109@tcp at head 00010000:00010000:2.0:1789302435.185201:0:19442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789302435.185386:0:19442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789302435.185432:0:19442:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789302435.185446:0:19442:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1ff82925bd39a7bb 00000100:00080000:2.0:1789302435.185456:0:19442:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789302435.185468:0:19442:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cc4b7e9b000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:2.0:1789302435.185503:0:19442:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc383a2ad80 x1876219121573504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789302435.185545:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876219121573504:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789302435.185611:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.185674:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121573504 00000100:00100000:2.0:1789302435.185681:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121573504 00000100:00100000:2.0:1789302435.185715:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302435.185722:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1876219121573504:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789302435.185745:0:18366:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1789302435.185789:0:18366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1ff82925bd39a7c2 00000004:00100000:2.0:1789302435.185804:0:18366:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789302435.185834:0:18366:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e9a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302435.185880:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876219121573504:12345-0@lo:38:llog_process_th.0 Request processed in 156us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302435.185888:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789302435.185928:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc383a2ad80 x1876219121573504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302435.185938:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789302435.185946:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789302435.185953:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789302435.185963:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789302435.185965:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e9b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789302435.185970:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876219121573504:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789302435.185990:0:19442:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789302435.186613:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302435.186618:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789302435.186621:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc486746000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302435.186625:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:1.0:1789302435.186629:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789302435.186636:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cc486746000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302435.186903:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc498ad5180 x1876219121573888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302435.186949:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302435.186953:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789302435.186955:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302435.186958:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 509 00000100:00080000:1.0:1789302435.186968:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789302435.186973:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cc4b5138800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:1.0:1789302435.186986:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc498ad5880 x1876219121574400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302435.188595:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121573632:0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.188758:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.188791:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121574272:0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.188817:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.188856:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789302435.188864:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121573760:0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.188887:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.188906:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121574528:0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.188929:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.188963:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121573888:0@lo:8:kworker.0 00000100:00100000:1.0:1789302435.188990:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.189008:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121574400:0@lo:8:kworker.0 00000100:00100000:1.0:1789302435.189027:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.189053:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121574016:0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.189075:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.189093:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121574656:0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.189138:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.189157:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789302435.189174:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121574144:0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.189196:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.189238:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121574784:0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.189262:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302435.189297:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121573632 00000100:00100000:1.0:1789302435.189304:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121573632 00000100:00100000:1.0:1789302435.189357:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121574144 00000100:00100000:1.0:1789302435.189361:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121574144 00000100:00100000:1.0:1789302435.189378:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789302435.189385:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121573632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.189440:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121573632:12345-0@lo:400:kworker.0 Request processed in 55us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.189447:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789302435.189463:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789302435.189469:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121574144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.189500:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121574144:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.189506:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789302435.189523:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121574272 00000100:00100000:1.0:1789302435.189526:0:18617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121574272 00000100:00100000:1.0:1789302435.189555:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121573760 00000100:00100000:1.0:1789302435.189558:0:18617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121573760 00000100:00100000:1.0:1789302435.189568:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121573888 00000100:00100000:1.0:1789302435.189571:0:18617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121573888 00000100:00100000:1.0:1789302435.189578:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121574400 00000100:00100000:1.0:1789302435.189581:0:18617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121574400 00000100:00100000:1.0:1789302435.189590:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302435.189596:0:18617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121574272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.189624:0:18617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121574272:12345-0@lo:400:kworker.0 Request processed in 29us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.189629:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302435.189648:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302435.189954:0:18617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121573760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.189987:0:18617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121573760:12345-0@lo:400:kworker.0 Request processed in 37us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.189992:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302435.190005:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302435.190009:0:18617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876219121573888:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789302435.190053:0:18617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876219121573888:12345-0@lo:8:kworker.0 Request processed in 43us (1062us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789302435.190058:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302435.190069:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302435.190072:0:18617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876219121574400:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789302435.190097:0:18617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876219121574400:12345-0@lo:8:kworker.0 Request processed in 24us (1070us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789302435.190103:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302435.190146:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121574528 00000100:00100000:1.0:1789302435.190151:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121574528 00000020:01000004:2.0:1789302435.190558:0:19442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789302435.190585:0:19442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8cc3828919c0) 00000020:00000080:2.0:1789302435.190606:0:19442:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789302435.190769:0:19442:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cc3829c5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789302435.190774:0:19442:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cc3829c5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789302435.190776:0:19442:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cc3829c5800 3 00010000:00080000:2.0:1789302435.190806:0:19442:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cc4b7e9f000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.109@tcp at head 00000100:00100000:1.0:1789302435.191765:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121574016 00000100:00100000:1.0:1789302435.191775:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121574016 00000100:00100000:1.0:1789302435.191797:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121574656 00000100:00100000:1.0:1789302435.191800:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121574656 00000100:00100000:1.0:1789302435.191818:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121574784 00000100:00100000:1.0:1789302435.191820:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121574784 00000100:00100000:1.0:1789302435.191838:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789302435.191917:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121574528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.191984:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121574528:12345-0@lo:400:kworker.0 Request processed in 138us (3054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.191992:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789302435.192014:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789302435.192020:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121574016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.192051:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121574016:12345-0@lo:400:kworker.0 Request processed in 32us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.192057:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789302435.192067:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789302435.192073:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121574656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.192096:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876219121574656:12345-0@lo:400:kworker.0 Request processed in 23us (2958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.192101:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789302435.192134:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789302435.192142:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121574784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.192178:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121574784:12345-0@lo:400:kworker.0 Request processed in 38us (2915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302435.192184:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789302435.192294:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789302435.192298:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302435.192301:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302435.192330:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789302435.192339:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc486746000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789302435.192344:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789302435.192348:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121573888:0@lo:8:kworker.0 00000100:00100000:1.0:1789302435.192359:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789302435.192362:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789302435.192365:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789302435.192368:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121574400:0@lo:8:kworker.0 00000100:00100000:1.0:1789302435.192411:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121574144:0@lo:400:kworker.0 00010000:00080000:1.0:1789302435.192423:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc383bffb80 x1876219121574784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302435.192434:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121574784:0@lo:400:kworker.0 00010000:00080000:1.0:1789302435.192444:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc498ad6300 x1876219121574016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302435.192453:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121574016:0@lo:400:kworker.0 00010000:00080000:1.0:1789302435.192461:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc383bfd500 x1876219121574656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302435.192469:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876219121574656:0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.192501:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121573760:0@lo:400:kworker.0 00010000:00080000:1.0:1789302435.192512:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc498ad7800 x1876219121574528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302435.192520:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121574528:0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.192530:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121573632:0@lo:400:kworker.0 00000100:00100000:1.0:1789302435.192541:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121574272:0@lo:400:kworker.0 00010000:00010000:2.0:1789302435.194410:0:19442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789302435.194599:0:19442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789302435.194644:0:19442:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789302435.194923:0:19442:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x1ff82925bd39a7d0 00000100:00080000:2.0:1789302435.194934:0:19442:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789302435.194944:0:19442:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8cc4b7e9f000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:2.0:1789302435.194979:0:19442:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc383a2ad80 x1876219121574912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789302435.195013:0:19442:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789302435.195155:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876219121574912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789302435.195235:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.195382:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121574912 00000100:00100000:2.0:1789302435.195388:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121574912 00000100:00100000:2.0:1789302435.195423:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302435.195430:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876219121574912:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789302435.195454:0:17112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1789302435.195498:0:17112:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x1ff82925bd39a7d7 00000004:00100000:2.0:1789302435.195512:0:17112:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789302435.195546:0:17112:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e9c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302435.195597:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876219121574912:12345-0@lo:38:llog_process_th.0 Request processed in 167us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302435.195604:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789302435.195642:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cc383a2ad80 x1876219121574912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302435.197188:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789302435.197200:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789302435.197276:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789302435.197282:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789302435.197285:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e9f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789302435.197293:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876219121574912:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789302435.197471:0:19442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789302435.197602:0:19429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789302435.197636:0:19429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789302435.197731:0:19429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd39a7a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a7ad expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302435.197744:0:19429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48166fe00/0x1ff82925bd39a7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a7ad expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789302435.197795:0:19429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789302435.197797:0:19429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789302435.197799:0:19429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302435.197800:0:19429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302435.197802:0:19429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302435.197803:0:19429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302435.197804:0:19429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302435.197806:0:19429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302435.197807:0:19429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789302435.197811:0:19429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789302435.197813:0:19429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789302435.197814:0:19429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789302435.197815:0:19429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302435.197816:0:19429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302435.197817:0:19429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302435.197818:0:19429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302435.197819:0:19429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302435.197820:0:19429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302435.197821:0:19429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789302435.197842:0:19429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789302435.198304:0:19429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121575040:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789302435.198366:0:19429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302435.198399:0:19429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc483b37d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302435.198817:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121575040 00000100:00100000:1.0:1789302435.198824:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121575040 00000100:00100000:1.0:1789302435.199380:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789302435.199392:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:19429:x1876219121575040:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789302435.199425:0:17105:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789302435.199445:0:17105:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789302435.207199:0:17105:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789302435.207227:0:17105:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789302435.207450:0:17126:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789302435.207456:0:17126:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789302435.207478:0:17126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.207497:0:17126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48311d800/0x1ff82925bd39a68e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a687 expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.207505:0:17126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc3839aac00/0x1ff82925bd39a69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a695 expref: 24 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.207513:0:17126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.207552:0:17126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc3839aac00/0x1ff82925bd39a69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a695 expref: 24 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.207579:0:17126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc3839aac00/0x1ff82925bd39a69c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a695 expref: 24 pid: 17104 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302435.207594:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121575168:0@lo:104: 00000100:00100000:2.0:1789302435.207666:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302435.207712:0:17126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48311d800/0x1ff82925bd39a68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a687 expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.207721:0:17126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc48311d800/0x1ff82925bd39a68e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a687 expref: 24 pid: 17105 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302435.207730:0:17126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121575296:0@lo:104: 00000100:00100000:2.0:1789302435.207750:0:17126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.207768:0:17126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302435.207785:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121575168 00000100:00100000:2.0:1789302435.207792:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121575168 00000100:00100000:2.0:1789302435.207824:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121575296 00000100:00100000:2.0:1789302435.207827:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121575296 00000100:00100000:2.0:1789302435.207838:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302435.207859:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+4:17126:x1876219121575168:12345-0@lo:104: 00010000:00010000:2.0:1789302435.207872:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.207919:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789302435.207925:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+4:17126:x1876219121575168:12345-0@lo:104: Request processed in 68us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302435.207931:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302435.207948:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302435.207961:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:17126:x1876219121575296:12345-0@lo:104: 00010000:00010000:2.0:1789302435.207969:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208008:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789302435.208013:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:17126:x1876219121575296:12345-0@lo:104: Request processed in 53us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302435.208017:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302435.208050:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121575168:0@lo:104: 00000100:00100000:2.0:1789302435.208058:0:17126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17126:1876219121575296:0@lo:104: 00010000:00010000:2.0:1789302435.208073:0:17126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208088:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302435.208092:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208098:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348200 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302435.208103:0:17099:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208135:0:17099:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302435.208142:0:17099:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302435.208147:0:17099:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302435.208184:0:17099:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208195:0:17099:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302435.208385:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208394:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348200/0x1ff82925bd39a695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a69c expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208407:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302435.208410:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208416:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348a00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:2.0:1789302435.208419:0:17099:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208425:0:17099:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302435.208431:0:17099:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302435.208436:0:17099:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789302435.208451:0:17099:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208457:0:17099:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302435.208463:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208470:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348a00/0x1ff82925bd39a687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a68e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208490:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302435.208492:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302435.208493:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302435.208500:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302435.208519:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121575552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302435.208549:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.208577:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302435.208583:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121575424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302435.208603:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302435.208630:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121575552 00000100:00100000:2.0:1789302435.208635:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121575552 00010000:00010000:2.0:1789302435.208714:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48311d800/0x1ff82925bd39a68e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a687 expref: 25 pid: 17105 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302435.208736:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121575424 00000100:00100000:2.0:1789302435.208739:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121575424 00010000:00010000:2.0:1789302435.208752:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc3839aac00/0x1ff82925bd39a69c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a695 expref: 26 pid: 17104 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302435.208763:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302435.208770:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+26:3646:x1876219121575552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302435.208780:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302435.208785:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48311d800/0x1ff82925bd39a68e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a687 expref: 26 pid: 17105 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208794:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48311d800/0x1ff82925bd39a68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a687 expref: 26 pid: 17105 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208816:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48311d800/0x1ff82925bd39a68e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a687 expref: 26 pid: 17105 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208828:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302435.208920:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+25:3646:x1876219121575552:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302435.208928:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302435.208941:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302435.208948:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:3646:x1876219121575424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302435.208956:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302435.208960:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc3839aac00/0x1ff82925bd39a69c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a695 expref: 24 pid: 17104 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208968:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc3839aac00/0x1ff82925bd39a69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a695 expref: 24 pid: 17104 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208978:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc3839aac00/0x1ff82925bd39a69c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a695 expref: 24 pid: 17104 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208989:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.208997:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789302435.209011:0:17095:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009282393s 00010000:00010000:2.0:1789302435.209016:0:17095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.209031:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.209038:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.209045:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.209050:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349e00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302435.209054:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.209062:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.209074:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.209083:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302435.209106:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:3646:x1876219121575424:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302435.209135:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789302435.209158:0:17126:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.209177:0:17126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302435.209182:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5349e00/0x1ff82925bd39a7de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302435.209404:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:19429:x1876219121575040:12345-0@lo:253:mount.lustre.0 Request processed in 10015us (11036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302435.209413:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789302435.209461:0:19429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c46098ed-e570-4ba8-9393-0223b90f3f6e:19429:1876219121575040:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789302435.209479:0:19429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789302435.209483:0:19429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789302435.209484:0:19429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789302435.209485:0:19429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302435.209487:0:19429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302435.209488:0:19429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302435.209489:0:19429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302435.209490:0:19429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302435.209492:0:19429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302435.209494:0:19429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789302435.209505:0:19429:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789302435.209972:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121575424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302435.209981:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c46098ed-e570-4ba8-9393-0223b90f3f6e:3646:1876219121575552:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789302435.211634:0:19429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789302435.226906:0:19429:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789302435.226915:0:19429:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789302435.226952:0:19429:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789302435.227001:0:19429:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789302435.227020:0:19429:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789302435.227035:0:19429:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789302435.227803:0:19429:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789302435.228033:0:19429:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789302435.351595:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789302436.160480:0:19495:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789302436.160844:0:19495:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789302436.372378:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789302436.564218:0:17107:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789302436.564226:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc4b5eab000 from 10 10000000:01000000:2.0:1789302436.564232:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789302436.564281:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd39a7e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302436.564294:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd39a7e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302436.564306:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd39a7e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302436.564332:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121575680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302436.564402:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302436.564443:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4912e2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789302436.565069:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121575680 00000100:00100000:1.0:1789302436.565078:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121575680 00000100:00100000:1.0:1789302436.565160:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789302436.565170:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:17107:x1876219121575680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302436.565185:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302436.565201:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166e200/0x1ff82925bd39a7ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a7e5 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302436.565226:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166e200/0x1ff82925bd39a7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a7e5 expref: 23 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302436.565237:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166e200/0x1ff82925bd39a7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a7e5 expref: 23 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302436.565246:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166e200, rc 0) 00000100:00100000:1.0:1789302436.565347:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121575680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302436.565354:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789302436.566809:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121575680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302436.566833:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd39a7e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a7ec expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302436.566844:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd39a7e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a7ec expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302436.566913:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121575808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789302436.566969:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302436.567239:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4830f7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789302436.567657:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121575808 00000100:00100000:0.0:1789302436.567665:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121575808 00000100:00100000:0.0:1789302436.567753:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789302436.567762:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121575808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789302436.567783:0:17105:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789302436.567801:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789302436.567804:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789302436.567901:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121575808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302436.567909:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789302436.567981:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121575808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789302436.568045:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789302436.568053:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd39a7e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a7ec expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302436.568063:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349800/0x1ff82925bd39a7e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a7ec expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302436.568073:0:17107:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789302436.568080:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cc38422d000 from 10 10000000:01000000:3.0:1789302436.568083:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789302436.568141:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd39a7f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302436.568149:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd39a7f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302436.568168:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd39a7f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302436.568185:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121575936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789302436.568215:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302436.568574:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302436.568649:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121575936 00000100:00100000:1.0:1789302436.568655:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121575936 00000100:00100000:1.0:1789302436.568684:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789302436.568692:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121575936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302436.568703:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302436.568716:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166e600/0x1ff82925bd39a7fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a7f3 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302436.568738:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166e600/0x1ff82925bd39a7fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a7f3 expref: 24 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302436.568759:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166e600/0x1ff82925bd39a7fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a7f3 expref: 24 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302436.568766:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166e600, rc 0) 00000100:00100000:1.0:1789302436.568845:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:17107:x1876219121575936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302436.568852:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789302436.568959:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121575936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302436.568970:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd39a7f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a7fa expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302436.568978:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd39a7f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a7fa expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302436.569019:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121576064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789302436.569049:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302436.569095:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302436.569266:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121576064 00000100:00100000:1.0:1789302436.569271:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121576064 00000100:00100000:1.0:1789302436.569332:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789302436.569338:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:17107:x1876219121576064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789302436.569349:0:17104:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789302436.569363:0:17104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789302436.569365:0:17104:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789302436.569441:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:17107:x1876219121576064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302436.569448:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789302436.569509:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121576064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789302436.569558:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789302436.569564:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd39a7f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a7fa expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302436.569582:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4aa983800/0x1ff82925bd39a7f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a7fa expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302437.397972:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302437.460430:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121576192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302437.460503:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302437.460609:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121576192 00000100:00100000:0.0:1789302437.460629:0:18620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121576192 00000100:00100000:0.0:1789302437.460695:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302437.460706:0:18620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121576192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302437.460752:0:18620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789302437.460806:0:18620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121576192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302437.460814:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302437.460864:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121576192:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789302437.460919:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789302438.424958:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302438.484277:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121576320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302438.484422:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302438.484488:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121576320 00000100:00100000:1.0:1789302438.484496:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121576320 00000100:00100000:1.0:1789302438.484562:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789302438.484572:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121576320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302438.484601:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789302438.484802:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121576320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302438.484812:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789302438.484833:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302438.484879:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121576320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302438.998382:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121576576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302438.998459:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302438.998503:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302438.998510:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121576448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302438.998533:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302438.998563:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121576576 00000100:00100000:2.0:1789302438.998570:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121576576 00000100:00100000:2.0:1789302438.998621:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121576448 00000100:00100000:2.0:1789302438.998625:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121576448 00000100:00100000:2.0:1789302438.998653:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789302438.998662:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121576576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302438.998703:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789302438.998747:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121576576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302438.998754:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789302438.998772:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789302438.998778:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121576448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302438.998799:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789302438.999231:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121576448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 452us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302438.999238:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789302438.999284:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121576448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302438.999298:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121576576:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789302439.446020:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.468543:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789302440.533923:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302440.533930:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789302440.533934:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc486746000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302440.533949:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cc486746000 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302440.533971:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc3843ee300 x1876219121577088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789302440.534003:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302440.534006:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789302440.534008:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302440.534014:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cc4b5138800 using connection 192.168.203.109@tcp/0@lo 00000100:00100000:0.0:1789302440.534025:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cc485d53800 x1876219121577600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302440.534075:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121576960:0@lo:400:kworker.0 00000100:00100000:0.0:1789302440.534174:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302440.534214:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121577728:0@lo:400:kworker.0 00000100:00100000:0.0:1789302440.534240:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302440.534256:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121578240:0@lo:400:kworker.0 00000100:00100000:0.0:1789302440.534279:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302440.534303:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789302440.534319:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121577216:0@lo:400:kworker.0 00000100:00100000:0.0:1789302440.534341:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302440.534366:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121577856:0@lo:400:kworker.0 00000100:00100000:0.0:1789302440.534388:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302440.534417:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121576960 00000100:00100000:0.0:1789302440.534425:0:18617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121576960 00000100:00100000:0.0:1789302440.534477:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302440.534486:0:18617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121576960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302440.534531:0:18617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121576960:12345-0@lo:400:kworker.0 Request processed in 46us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302440.534538:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302440.534560:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121577728 00000100:00100000:0.0:1789302440.534564:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121577728 00000100:00100000:0.0:1789302440.534581:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121578240 00000100:00100000:0.0:1789302440.534583:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121578240 00000100:00100000:0.0:1789302440.534596:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121577216 00000100:00100000:0.0:1789302440.534598:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121577216 00000100:00100000:0.0:1789302440.534609:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121577856 00000100:00100000:0.0:1789302440.534611:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121577856 00000100:00100000:0.0:1789302440.534625:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789302440.534631:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121577728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302440.534660:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121577728:12345-0@lo:400:kworker.0 Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302440.534666:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789302440.534677:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789302440.534683:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121578240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302440.534707:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121578240:12345-0@lo:400:kworker.0 Request processed in 25us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302440.534737:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789302440.534750:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789302440.534756:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121577216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302440.534786:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121577216:12345-0@lo:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302440.534791:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789302440.534802:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789302440.534807:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121577856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302440.534830:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876219121577856:12345-0@lo:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302440.534836:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789302440.534856:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302440.534860:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302440.534862:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302440.534988:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc3843ed180 x1876219121577216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302440.535000:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121577216:0@lo:400:kworker.0 00010000:00080000:0.0:1789302440.535010:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d52300 x1876219121577856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302440.535017:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876219121577856:0@lo:400:kworker.0 00000100:00100000:0.0:1789302440.535026:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121576960:0@lo:400:kworker.0 00010000:00080000:0.0:1789302440.535034:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d53480 x1876219121577728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302440.535041:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121577728:0@lo:400:kworker.0 00010000:00080000:0.0:1789302440.535062:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d52a00 x1876219121578240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302440.535068:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121578240:0@lo:400:kworker.0 00000100:00100000:2.0:1789302440.535545:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121576832:0@lo:400:kworker.0 00000100:00100000:2.0:1789302440.535589:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302440.535626:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121577472:0@lo:400:kworker.0 00000100:00100000:2.0:1789302440.535648:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302440.535668:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121578112:0@lo:400:kworker.0 00000100:00100000:2.0:1789302440.535688:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302440.535706:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789302440.535711:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121576704:0@lo:400:kworker.0 00000100:00100000:2.0:1789302440.535745:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302440.535767:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121577344:0@lo:400:kworker.0 00000100:00100000:2.0:1789302440.535787:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302440.535803:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121577984:0@lo:400:kworker.0 00000100:00100000:2.0:1789302440.535832:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302440.535861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121577088:0@lo:8:kworker.0 00000100:00100000:2.0:1789302440.535887:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302440.535903:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121577600:0@lo:8:kworker.0 00000100:00100000:2.0:1789302440.535922:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302440.535951:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121578112 00000100:00100000:2.0:1789302440.535956:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121578112 00000100:00100000:2.0:1789302440.535986:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121577984 00000100:00100000:2.0:1789302440.535989:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121577984 00000100:00100000:2.0:1789302440.536001:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789302440.536006:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121578112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302440.536044:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121578112:12345-0@lo:400:kworker.0 Request processed in 37us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302440.536050:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789302440.536069:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789302440.536075:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121577984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302440.536099:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876219121577984:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302440.536104:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789302440.536151:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121577472 00000100:00100000:2.0:1789302440.536154:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121577472 00000100:00100000:2.0:1789302440.536179:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121577088 00000100:00100000:2.0:1789302440.536192:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121577088 00000100:00100000:2.0:1789302440.536203:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121577600 00000100:00100000:2.0:1789302440.536205:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121577600 00000100:00100000:2.0:1789302440.536214:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302440.536220:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121577472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302440.536262:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121577472:12345-0@lo:400:kworker.0 Request processed in 42us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302440.536268:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302440.536280:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789302440.536284:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876219121577088:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789302440.536308:0:19064:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1789302440.536335:0:19064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1ff82925bd39a801 00002000:00100000:2.0:1789302440.536349:0:19064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cc4b7e9e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789302440.536352:0:19064:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789302440.536556:0:19064:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789302440.537263:0:19064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789302440.537289:0:19064:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e99000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302440.537339:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876219121577088:12345-0@lo:8:kworker.0 Request processed in 1053us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302440.537355:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789302440.537491:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789302440.537496:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876219121577600:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789302440.537515:0:19064:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1789302440.537534:0:19064:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x1ff82925bd39a808 00002000:00100000:2.0:1789302440.537542:0:19064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8cc4b7e98800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789302440.537546:0:19064:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789302440.537548:0:19064:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789302440.537576:0:19064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789302440.537588:0:19064:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e9d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302440.537619:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1876219121577600:12345-0@lo:8:kworker.0 Request processed in 120us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302440.537624:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789302440.537644:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121576704 00000100:00100000:2.0:1789302440.537649:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121576704 00000100:00100000:2.0:1789302440.537883:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789302440.537891:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:3648:x1876219121576704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302440.537922:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:3648:x1876219121576704:12345-0@lo:400:kworker.0 Request processed in 33us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302440.537927:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789302440.538060:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121576832 00000100:00100000:0.0:1789302440.538065:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121576832 00000100:00100000:0.0:1789302440.538091:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121577344 00000100:00100000:0.0:1789302440.538094:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121577344 00000100:00100000:0.0:1789302440.538109:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789302440.538145:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121576832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302440.538479:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789302440.538488:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121577344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302440.538524:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121577344:12345-0@lo:400:kworker.0 Request processed in 38us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302440.538531:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789302440.538864:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121576832:12345-0@lo:400:kworker.0 Request processed in 38us (2592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302440.538873:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789302440.539735:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302440.539742:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789302440.539745:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789302440.547912:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc3843ee300 x1876219121577088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789302440.547935:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789302440.547944:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789302440.547951:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789302440.547955:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc486746000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789302440.547980:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789302440.547987:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876219121577088:0@lo:8:kworker.0 00010000:00080000:1.0:1789302440.548004:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d53800 x1876219121577600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789302440.548014:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789302440.548018:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789302440.548021:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789302440.548023:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8cc4b5138800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789302440.548045:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789302440.548049:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876219121577600:0@lo:8:kworker.0 00000004:00080000:1.0:1789302440.548143:0:17854:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789302440.548167:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17854:1876219121578496:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789302440.548224:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302440.548249:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4913d7b40 going to sleep for 11 seconds 00000004:00080000:1.0:1789302440.548267:0:17853:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789302440.548427:0:17853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 516591313788ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789302440.548436:0:17853:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789302440.548457:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302440.548466:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121578368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302440.548494:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789302440.548845:0:17137:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1789302440.548859:0:17137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17137:1876219121578752:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789302440.548886:0:17137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302440.548902:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4912e2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302440.548919:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121578496 00000100:00100000:2.0:1789302440.548932:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121578496 00000100:00100000:2.0:1789302440.548992:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121578752 00000100:00100000:2.0:1789302440.548995:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121578752 00000100:00100000:2.0:1789302440.549017:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789302440.549025:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17854:x1876219121578496:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1789302440.549218:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302440.549233:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302440.549240:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17137:x1876219121578752:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789302440.549281:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121578624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302440.549307:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302440.549999:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121578368 00000100:00100000:1.0:1789302440.550005:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121578368 00000100:00100000:1.0:1789302440.550025:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121578624 00000100:00100000:1.0:1789302440.550028:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121578624 00000100:00100000:1.0:1789302440.550038:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789302440.550045:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876219121578368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302440.550064:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789302440.550107:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876219121578368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302440.550139:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789302440.550154:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789302440.550160:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121578624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302440.550168:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789302440.550194:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876219121578624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302440.550207:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789302440.550248:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc38489f800 x1876219121578624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302440.550267:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121578624:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789302440.550292:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bffb80 x1876219121578368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302440.550303:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121578368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789302440.550325:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121576704:0@lo:400:kworker.0 00000100:00100000:1.0:1789302440.550336:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121577344:0@lo:400:kworker.0 00010000:00080000:1.0:1789302440.550347:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d50a80 x1876219121577984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1789302440.552544:0:18618:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789302440.552554:0:18618:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789302440.552639:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17854:x1876219121578496:12345-0@lo:7:osp-pre-1-1.0 Request processed in 3612us (4412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302440.552650:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789302440.552892:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876219121577984:0@lo:400:kworker.0 00000004:00080000:0.0:1789302440.553901:0:17136:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789302440.553987:0:17136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 516596874042ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789302440.553995:0:17136:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:1.0:1789302440.554623:0:17854:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bff100 x1876219121578496/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789302456 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302440.554639:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17854:1876219121578496:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789302440.554653:0:17854:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789302440.554691:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17854:1876219121578880:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789302440.555551:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302440.555586:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4913d7b40 going to sleep for 11 seconds 00000004:00080000:1.0:1789302440.555625:0:17842:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789302440.555664:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121576832:0@lo:400:kworker.0 00000100:00100000:1.0:1789302440.555689:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121577472:0@lo:400:kworker.0 00010000:00080000:1.0:1789302440.555708:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d53b80 x1876219121578112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302440.556451:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121578112:0@lo:400:kworker.0 00002000:00080000:2.0:1789302440.558475:0:18616:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789302440.558487:0:18616:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789302440.558493:0:18616:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:3.0:1789302440.560312:0:17090:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789302440.561501:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121578880 00000100:00100000:3.0:1789302440.561515:0:18617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121578880 00000100:00100000:3.0:1789302440.561574:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789302440.561584:0:18617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17854:x1876219121578880:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789302440.561615:0:18617:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789302440.561692:0:18617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17854:x1876219121578880:12345-0@lo:5:osp-pre-1-1.0 Request processed in 109us (6143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302440.561699:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789302440.562856:0:17854:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383bff100 x1876219121578880/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302456 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302440.562871:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17854:1876219121578880:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789302440.562886:0:17854:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789302440.562929:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17854:1876219121579008:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789302440.562974:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302440.562999:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc383ba8840 going to sleep for 11 seconds 00000100:00100000:3.0:1789302440.563030:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121579008 00000100:00100000:3.0:1789302440.563036:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121579008 00000100:00100000:3.0:1789302440.563072:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789302440.563080:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17854:x1876219121579008:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789302440.563142:0:19064:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1789302440.581906:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789302440.581917:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a80f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.581933:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789302440.581937:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302440.581943:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a80f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.581960:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a80f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.581977:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a80f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.581984:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a80f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.581998:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789302440.582320:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302440.582327:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a80f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.582335:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302440.582339:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a80f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.582347:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a80f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.587036:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a80f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.587056:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a80f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.587080:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.587091:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.587094:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302440.590942:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789302440.590955:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd49bbd/0x1ff82925bd39a816 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.590971:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1789302440.590975:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302440.590980:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cd49bbd/0x1ff82925bd39a816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.590995:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cd49bbd/0x1ff82925bd39a816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.591014:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd49bbd/0x1ff82925bd39a816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.591022:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cd49bbd/0x1ff82925bd39a816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.591043:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302440.591084:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302440.591090:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cd49bbd/0x1ff82925bd39a816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.591098:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538f800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.591102:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd49bbd/0x1ff82925bd39a816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.591137:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd49bbd/0x1ff82925bd39a816 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.591156:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cd49bbd/0x1ff82925bd39a816 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.591163:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cd49bbd/0x1ff82925bd39a816 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.591180:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.591189:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.591190:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302440.595863:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.595876:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd39a81d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.595893:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.595897:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.595904:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd39a81d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.595920:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd39a81d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.595930:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd39a81d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.595937:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd39a81d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.595957:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302440.596139:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302440.596146:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd39a81d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.596154:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983a00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302440.596159:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd39a81d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.596181:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd39a81d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.596198:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd39a81d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.596206:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c9ef43/0x1ff82925bd39a81d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.596225:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.596227:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.596228:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302440.596635:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.596642:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a824 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.596651:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.596655:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.596659:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.596669:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.596677:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.596691:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.596708:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1789302440.597010:0:19430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789302440.597024:0:19430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789302440.597028:0:19430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789302440.597169:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302440.597175:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.597183:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.597186:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.597195:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a824 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.597207:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a824 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.597213:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a824 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.597228:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.597230:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.597232:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302440.598098:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.598109:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a82b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.598189:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.598194:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.598199:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a82b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.598210:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a82b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.598219:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a82b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.598225:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a82b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.599044:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789302440.599459:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17854:x1876219121579008:12345-0@lo:5:osp-pre-1-1.0 Request processed in 36374us (36480us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789302440.599479:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789302440.599532:0:17854:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789302440.599540:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17854:1876219121579008:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789302440.599556:0:17854:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789302440.599605:0:17854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17854:1876219121579136:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789302440.599638:0:17854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302440.599660:0:17854:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b87b6180 going to sleep for 11 seconds 00000100:00100000:3.0:1789302440.599683:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121579136 00000100:00100000:3.0:1789302440.599689:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121579136 00000100:00100000:3.0:1789302440.599723:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302440.599731:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17854:x1876219121579136:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789302440.599774:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17854:x1876219121579136:12345-0@lo:900:osp-pre-1-1.0 Request processed in 43us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302440.599779:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789302440.599815:0:17854:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc381f74380 x1876219121579136/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789302456 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302440.599824:0:17854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc381f74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17854:1876219121579136:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1789302440.600884:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.600894:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a832 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.600915:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.600919:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.600924:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.600946:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.600957:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.600964:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.606918:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789302440.606934:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a82b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.606963:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982e00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.606967:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a82b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.606978:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a82b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.607001:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a82b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.607008:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a82b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.607036:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302440.607040:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.607046:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983000 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.607048:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.607055:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.607064:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a832 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.607079:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.607080:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.607083:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.607910:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789302440.607918:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a832 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302440.608682:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.608689:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a839 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.608701:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.608706:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.608711:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.608724:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.608746:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.608753:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.608767:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789302440.608904:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302440.608911:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.608919:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983400 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302440.608924:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.608934:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a839 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.608948:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a839 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.608956:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a839 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.608971:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.608973:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.608974:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.609241:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302440.609983:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.609990:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006481e248/0x1ff82925bd39a840 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.610002:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.610006:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.610011:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006481e248/0x1ff82925bd39a840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.610021:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006481e248/0x1ff82925bd39a840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.610029:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006481e248/0x1ff82925bd39a840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.610036:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006481e248/0x1ff82925bd39a840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.610061:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789302440.610488:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.610494:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a213d39c/0x1ff82925bd39a847 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.610502:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.610505:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.610509:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a213d39c/0x1ff82925bd39a847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.610518:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a213d39c/0x1ff82925bd39a847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.610525:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a213d39c/0x1ff82925bd39a847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.610532:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a213d39c/0x1ff82925bd39a847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.610553:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789302440.610782:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789302440.610789:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006481e248/0x1ff82925bd39a840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.610796:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178a00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.610800:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006481e248/0x1ff82925bd39a840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.610818:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006481e248/0x1ff82925bd39a840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.610833:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006481e248/0x1ff82925bd39a840 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.610840:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006481e248/0x1ff82925bd39a840 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.610858:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302440.610860:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a213d39c/0x1ff82925bd39a847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.610867:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2179000 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.610876:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a213d39c/0x1ff82925bd39a847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.610884:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a213d39c/0x1ff82925bd39a847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.610895:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a213d39c/0x1ff82925bd39a847 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.610901:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a213d39c/0x1ff82925bd39a847 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.610915:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.610916:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.610918:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302440.611031:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.611036:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005aa8b90e/0x1ff82925bd39a84e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.611045:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.611053:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.611058:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005aa8b90e/0x1ff82925bd39a84e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.611068:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005aa8b90e/0x1ff82925bd39a84e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.611076:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005aa8b90e/0x1ff82925bd39a84e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.611083:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005aa8b90e/0x1ff82925bd39a84e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.611101:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302440.611376:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302440.611381:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005aa8b90e/0x1ff82925bd39a84e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.611388:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2179c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.611391:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005aa8b90e/0x1ff82925bd39a84e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.611399:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005aa8b90e/0x1ff82925bd39a84e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.611410:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005aa8b90e/0x1ff82925bd39a84e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.611423:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005aa8b90e/0x1ff82925bd39a84e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.611436:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.611438:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.611439:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302440.611508:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.611513:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c0bfb3/0x1ff82925bd39a855 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.611522:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.611525:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.611529:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c0bfb3/0x1ff82925bd39a855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.611539:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1c0bfb3/0x1ff82925bd39a855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.611546:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c0bfb3/0x1ff82925bd39a855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.611558:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c0bfb3/0x1ff82925bd39a855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.611577:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302440.611821:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302440.611826:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1c0bfb3/0x1ff82925bd39a855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.611834:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2179a00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.611838:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c0bfb3/0x1ff82925bd39a855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.611845:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c0bfb3/0x1ff82925bd39a855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.611855:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1c0bfb3/0x1ff82925bd39a855 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.611862:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c0bfb3/0x1ff82925bd39a855 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.611876:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.611878:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.611879:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.611975:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302440.612072:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.612078:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000379f50e7/0x1ff82925bd39a85c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.612087:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.612090:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.612094:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000379f50e7/0x1ff82925bd39a85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.612105:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000379f50e7/0x1ff82925bd39a85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.612155:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000379f50e7/0x1ff82925bd39a85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.612163:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000379f50e7/0x1ff82925bd39a85c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.612177:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302440.612554:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302440.612560:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000379f50e7/0x1ff82925bd39a85c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.612568:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178200 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.612572:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000379f50e7/0x1ff82925bd39a85c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.612581:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000379f50e7/0x1ff82925bd39a85c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.612593:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000379f50e7/0x1ff82925bd39a85c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.612600:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000379f50e7/0x1ff82925bd39a85c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.612615:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.612617:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.612618:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302440.612804:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.613067:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5b19476/0x1ff82925bd39a863 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613082:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.613085:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.613090:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b19476/0x1ff82925bd39a863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613100:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5b19476/0x1ff82925bd39a863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613109:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5b19476/0x1ff82925bd39a863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613154:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b19476/0x1ff82925bd39a863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613168:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789302440.613448:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302440.613455:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5b19476/0x1ff82925bd39a863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.613474:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178400 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302440.613477:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5b19476/0x1ff82925bd39a863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.613485:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5b19476/0x1ff82925bd39a863 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.613497:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5b19476/0x1ff82925bd39a863 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.613504:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5b19476/0x1ff82925bd39a863 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.613519:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.613521:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.613523:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302440.613602:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.613608:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39a86a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613617:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.613620:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.613624:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39a86a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613633:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39a86a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613652:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39a86a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613660:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39a86a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613675:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789302440.613937:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.613943:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049f66373/0x1ff82925bd39a871 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613951:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.613954:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.613958:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049f66373/0x1ff82925bd39a871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613966:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049f66373/0x1ff82925bd39a871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613973:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049f66373/0x1ff82925bd39a871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.613981:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049f66373/0x1ff82925bd39a871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.614044:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789302440.614436:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.614442:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba2ec9a1/0x1ff82925bd39a878 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.614451:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.614453:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.614457:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba2ec9a1/0x1ff82925bd39a878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.614465:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba2ec9a1/0x1ff82925bd39a878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.614473:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba2ec9a1/0x1ff82925bd39a878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.614480:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba2ec9a1/0x1ff82925bd39a878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614691:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789302440.614697:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39a86a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614706:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302440.614710:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39a86a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614718:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39a86a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614739:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39a86a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614746:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3bc239a/0x1ff82925bd39a86a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614760:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302440.614763:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049f66373/0x1ff82925bd39a871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614770:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2179200 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302440.614772:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f66373/0x1ff82925bd39a871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614779:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f66373/0x1ff82925bd39a871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614788:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049f66373/0x1ff82925bd39a871 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614795:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049f66373/0x1ff82925bd39a871 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614863:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302440.614868:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba2ec9a1/0x1ff82925bd39a878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614881:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302440.614884:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba2ec9a1/0x1ff82925bd39a878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614892:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba2ec9a1/0x1ff82925bd39a878 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614904:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba2ec9a1/0x1ff82925bd39a878 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.614912:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.614914:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.614915:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.614941:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.614996:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789302440.615001:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba2ec9a1/0x1ff82925bd39a878 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302440.615369:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.615374:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000b79707/0x1ff82925bd39a87f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.615389:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.615392:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.615397:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000b79707/0x1ff82925bd39a87f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.615408:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000b79707/0x1ff82925bd39a87f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.615417:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000b79707/0x1ff82925bd39a87f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.615423:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000b79707/0x1ff82925bd39a87f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.615560:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302440.615565:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000b79707/0x1ff82925bd39a87f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.615572:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4c2178600 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302440.615575:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000b79707/0x1ff82925bd39a87f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.615583:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000b79707/0x1ff82925bd39a87f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.615595:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000b79707/0x1ff82925bd39a87f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.615609:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.615611:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.615613:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.615669:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789302440.615674:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000b79707/0x1ff82925bd39a87f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302440.615945:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.615951:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a886 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.615959:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.615962:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.615966:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.615987:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.615995:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.616002:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.616026:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302440.616032:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.616039:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982e00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.616043:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.616061:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a886 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.616072:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a886 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.616081:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.616082:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.616084:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.616284:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789302440.616290:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c30079e1/0x1ff82925bd39a886 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302440.616834:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.616840:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a88d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.616850:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.616853:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.616857:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a88d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.616868:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a88d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.616890:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a88d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.616897:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a88d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.617285:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302440.617292:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a88d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.617478:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302440.617482:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a88d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.617491:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a88d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.617504:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a88d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.617513:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.617515:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.617516:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.617599:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789302440.617605:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d78d7566/0x1ff82925bd39a88d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302440.617957:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.617963:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a894 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.617973:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.617978:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.617983:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.617994:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.618004:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.618023:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.618055:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302440.618061:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.618070:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983000 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.618074:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.618083:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a894 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.618095:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a894 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.618103:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.618105:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.618107:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.618266:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789302440.618271:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d7c0d6a/0x1ff82925bd39a894 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302440.618679:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789302440.618685:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a89b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.618693:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1789302440.618697:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302440.618701:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a89b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.618710:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a89b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.618717:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a89b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.618723:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a89b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.618765:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302440.618770:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a89b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.618778:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983400 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302440.618781:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a89b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.618795:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a89b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.618815:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a89b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.618825:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.618827:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.618829:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.618938:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789302440.618943:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085531f52/0x1ff82925bd39a89b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302440.619462:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789302440.619469:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a8a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.619478:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789302440.619481:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302440.619486:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a8a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.619497:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a8a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.619506:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a8a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.619513:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a8a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.619750:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302440.619756:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a8a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.619764:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.619769:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a8a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.619777:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a8a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.619789:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a8a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.619797:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.619799:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.619801:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.619917:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789302440.619922:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009c45c7a/0x1ff82925bd39a8a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302440.620878:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789302440.620886:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae0aff2/0x1ff82925bd39a8a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.620898:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789302440.620902:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302440.620907:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fae0aff2/0x1ff82925bd39a8a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.620919:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fae0aff2/0x1ff82925bd39a8a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.620929:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae0aff2/0x1ff82925bd39a8a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.620936:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fae0aff2/0x1ff82925bd39a8a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.621292:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302440.621415:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fae0aff2/0x1ff82925bd39a8a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.621425:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349e00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:0.0:1789302440.621429:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae0aff2/0x1ff82925bd39a8a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.621438:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae0aff2/0x1ff82925bd39a8a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.621464:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fae0aff2/0x1ff82925bd39a8a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302440.621473:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.621475:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.621502:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789302440.621508:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fae0aff2/0x1ff82925bd39a8a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302440.621868:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789302440.621875:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434c7f6e/0x1ff82925bd39a8b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.621884:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789302440.621888:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302440.621893:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000434c7f6e/0x1ff82925bd39a8b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.621902:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000434c7f6e/0x1ff82925bd39a8b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.621911:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434c7f6e/0x1ff82925bd39a8b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.621919:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000434c7f6e/0x1ff82925bd39a8b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.621977:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302440.621983:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000434c7f6e/0x1ff82925bd39a8b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.621990:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348a00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302440.621994:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000434c7f6e/0x1ff82925bd39a8b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.622002:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000434c7f6e/0x1ff82925bd39a8b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.622012:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000434c7f6e/0x1ff82925bd39a8b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.622020:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.622022:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.622023:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302440.622045:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.622101:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789302440.622106:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000434c7f6e/0x1ff82925bd39a8b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302440.622553:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789302440.622560:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c56e4227/0x1ff82925bd39a8b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.622579:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789302440.622582:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302440.622587:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c56e4227/0x1ff82925bd39a8b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.622597:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c56e4227/0x1ff82925bd39a8b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.622605:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c56e4227/0x1ff82925bd39a8b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.622613:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c56e4227/0x1ff82925bd39a8b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.622655:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302440.622660:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c56e4227/0x1ff82925bd39a8b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.622668:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348200 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302440.622677:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c56e4227/0x1ff82925bd39a8b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.622685:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c56e4227/0x1ff82925bd39a8b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.622696:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c56e4227/0x1ff82925bd39a8b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.622704:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.622705:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.622707:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302440.622740:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789302440.622745:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c56e4227/0x1ff82925bd39a8b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302440.623016:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789302440.623022:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a8be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.623030:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789302440.623033:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302440.623037:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a8be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.623057:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a8be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.623066:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a8be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.623073:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a8be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.623091:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302440.623312:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302440.623317:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a8be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.623325:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302440.623337:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a8be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.623345:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a8be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.623356:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a8be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.623362:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d7d4dd6/0x1ff82925bd39a8be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.623384:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.623386:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.623388:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789302440.623509:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789302440.623514:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd39a8c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.623522:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789302440.623525:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302440.623530:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd39a8c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.623539:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd39a8c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.623547:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd39a8c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.623564:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd39a8c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.623582:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302440.623814:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302440.623819:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd39a8c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.623827:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348e00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302440.623830:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd39a8c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.623837:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd39a8c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.623847:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd39a8c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.623854:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011123817/0x1ff82925bd39a8c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.623868:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.623870:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.623871:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789302440.623979:0:18616:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789302440.623985:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021d83b2e/0x1ff82925bd39a8cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.623993:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1789302440.623996:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302440.624000:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021d83b2e/0x1ff82925bd39a8cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.624010:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021d83b2e/0x1ff82925bd39a8cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.624017:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021d83b2e/0x1ff82925bd39a8cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.624023:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021d83b2e/0x1ff82925bd39a8cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302440.624042:0:18616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789302440.624071:0:18616:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1789302440.624178:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17137:x1876219121578752:12345-0@lo:5:osp-pre-1-0.0 Request processed in 74935us (75288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302440.624195:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302440.624247:0:17137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17137:1876219121578752:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789302440.624264:0:17137:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1789302440.624303:0:17137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17137:1876219121579264:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789302440.624335:0:17137:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302440.624355:0:17137:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc486159480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302440.624369:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121579264 00000100:00100000:2.0:1789302440.624375:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121579264 00000100:00100000:2.0:1789302440.624409:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789302440.624417:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17137:x1876219121579264:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1789302440.624500:0:17098:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302440.624505:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021d83b2e/0x1ff82925bd39a8cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.624525:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:3.0:1789302440.624529:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021d83b2e/0x1ff82925bd39a8cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.624536:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021d83b2e/0x1ff82925bd39a8cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.624548:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021d83b2e/0x1ff82925bd39a8cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.624555:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021d83b2e/0x1ff82925bd39a8cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302440.624569:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.624571:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302440.624583:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789302440.624644:0:18616:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1789302440.627628:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302440.634946:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17137:x1876219121579264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10518us (10599us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789302440.634961:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789302440.636186:0:17137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17137:1876219121579264:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789302440.636207:0:17137:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:1.0:1789302440.916863:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1789302441.295213:0:19785:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg309-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789302441.495026:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789302442.340090:0:19837:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789302442.340580:0:19837:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789302442.517108:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302442.583985:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121579392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789302442.584051:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302442.585938:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121579392 00000100:00100000:0.0:1789302442.585950:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121579392 00000100:00100000:0.0:1789302442.586026:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302442.586038:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121579392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302442.586068:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789302442.586170:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121579392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302442.586177:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789302442.586302:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302442.586480:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121579392:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1789302443.297834:0:19887:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789302443.298060:0:19887:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789302443.540249:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302443.604440:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302443.604467:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121579520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302443.604556:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302443.605437:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121579520 00000100:00100000:1.0:1789302443.605448:0:18620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121579520 00000100:00100000:1.0:1789302443.605572:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789302443.605582:0:18620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121579520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302443.605607:0:18620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789302443.605675:0:18620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121579520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302443.605682:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302443.606619:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121579520:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789302443.609562:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302443.688367:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302443.688732:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101564288 00000100:00100000:1.0:1789302443.688743:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101564288 00000100:00100000:1.0:1789302443.688801:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 115 00000100:00100000:1.0:1789302443.688810:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2395:x1876219101564288:12345-192.168.203.9@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789302443.688839:0:17104:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6def970d-8bc0-4857-87d9-88981813c2ca@192.168.203.9@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:1.0:1789302443.688869:0:17104:0:(genops.c:1384:class_connect()) connect: client 6def970d-8bc0-4857-87d9-88981813c2ca, cookie 0x1ff82925bd39a8d3 00000100:00080000:1.0:1789302443.689000:0:17104:0:(import.c:65:import_set_state_nolock()) ffff8cc484fba000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302443.689082:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+5:2395:x1876219101564288:12345-192.168.203.9@tcp:250:mount.lustre.0 Request processed in 262us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302443.689146:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 115 00000100:00100000:3.0:1789302443.704680:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302443.704881:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101564416 00000100:00100000:2.0:1789302443.704892:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101564416 00000100:00100000:2.0:1789302443.704953:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 116 00000100:00100000:2.0:1789302443.704963:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+5:14886:x1876219101564416:12345-192.168.203.9@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789302443.704979:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302443.704996:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5348200/0x1ff82925bd39a8da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5e02 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302443.705055:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5348200/0x1ff82925bd39a8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e02 expref: 6 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302443.705067:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5348200/0x1ff82925bd39a8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e02 expref: 6 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302443.705086:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348200, rc 0) 00000100:00100000:2.0:1789302443.705171:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+6:14886:x1876219101564416:12345-192.168.203.9@tcp:101:mount.lustre.0 Request processed in 210us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302443.705179:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 116 00000100:00100000:0.0:1789302443.707369:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302443.707513:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101564544 00000100:00100000:3.0:1789302443.707523:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101564544 00000100:00100000:3.0:1789302443.707579:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 117 00000100:00100000:3.0:1789302443.707589:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+6:14886:x1876219101564544:12345-192.168.203.9@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789302443.707703:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+6:14886:x1876219101564544:12345-192.168.203.9@tcp:501:mount.lustre.0 Request processed in 114us (349us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302443.707711:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 117 00000100:00100000:0.0:1789302443.716433:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302443.716635:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101564672 00000100:00100000:1.0:1789302443.716646:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101564672 00000100:00100000:1.0:1789302443.716700:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 118 00000100:00100000:1.0:1789302443.716709:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+6:14886:x1876219101564672:12345-192.168.203.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789302443.716725:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302443.716741:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166ec00/0x1ff82925bd39a8e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5e09 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302443.716768:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166ec00/0x1ff82925bd39a8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e09 expref: 7 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302443.716780:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166ec00/0x1ff82925bd39a8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e09 expref: 7 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302443.716789:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166ec00, rc 0) 00000100:00100000:1.0:1789302443.716840:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+7:14886:x1876219101564672:12345-192.168.203.9@tcp:101:mount.lustre.0 Request processed in 132us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302443.716847:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 118 00000100:00100000:0.0:1789302443.725901:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302443.726009:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101564800 00000100:00100000:2.0:1789302443.726028:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101564800 00000100:00100000:2.0:1789302443.726093:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 119 00000100:00100000:2.0:1789302443.726148:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+7:14886:x1876219101564800:12345-192.168.203.9@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789302443.726312:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+8:14886:x1876219101564800:12345-192.168.203.9@tcp:501:mount.lustre.0 Request processed in 208us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302443.726319:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 119 00000100:00100000:0.0:1789302443.732088:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302443.732464:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101564928 00000100:00100000:1.0:1789302443.732473:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101564928 00000100:00100000:1.0:1789302443.732519:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 120 00000100:00100000:1.0:1789302443.732529:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+8:14886:x1876219101564928:12345-192.168.203.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789302443.732675:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+8:14886:x1876219101564928:12345-192.168.203.9@tcp:503:mount.lustre.0 Request processed in 147us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302443.732683:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 120 00000100:00100000:0.0:1789302443.749187:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302443.749356:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101565056 00000100:00100000:3.0:1789302443.749367:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101565056 00000100:00100000:3.0:1789302443.749409:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 121 00000100:00100000:3.0:1789302443.749418:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+8:14905:x1876219101565056:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789302443.749559:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+8:14905:x1876219101565056:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 140us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302443.749567:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 121 00000100:00100000:3.0:1789302443.784558:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302443.784673:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101565184 00000100:00100000:2.0:1789302443.784688:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101565184 00000100:00100000:2.0:1789302443.784764:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 122 00000100:00100000:2.0:1789302443.784775:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+8:14905:x1876219101565184:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789302443.784948:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+8:14905:x1876219101565184:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 174us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302443.784957:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 122 00000100:00100000:0.0:1789302443.796372:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302443.796681:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101565312 00000100:00100000:3.0:1789302443.796700:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101565312 00000100:00100000:3.0:1789302443.796796:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 123 00000100:00100000:3.0:1789302443.796809:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+8:14905:x1876219101565312:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789302443.797032:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+8:14905:x1876219101565312:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 224us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302443.797042:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 123 00000100:00100000:0.0:1789302443.811594:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302443.813862:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101565440 00000100:00100000:1.0:1789302443.813882:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101565440 00000100:00100000:1.0:1789302443.814739:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 124 00000100:00100000:1.0:1789302443.814761:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+8:14886:x1876219101565440:12345-192.168.203.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789302443.814794:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302443.814818:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166e400/0x1ff82925bd39a8e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5e3a expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302443.814855:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166e400/0x1ff82925bd39a8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e3a expref: 9 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302443.814870:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166e400/0x1ff82925bd39a8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e3a expref: 9 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302443.814881:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166e400, rc 0) 00000100:00100000:1.0:1789302443.814978:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+9:14886:x1876219101565440:12345-192.168.203.9@tcp:101:mount.lustre.0 Request processed in 226us (3398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302443.814986:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 124 00000100:00100000:1.0:1789302443.827698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302443.827886:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101565568 00000100:00100000:2.0:1789302443.827922:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101565568 00000100:00100000:2.0:1789302443.828254:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 125 00000100:00100000:2.0:1789302443.828267:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+9:14886:x1876219101565568:12345-192.168.203.9@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789302443.828302:0:17102:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789302443.828324:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789302443.828329:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789302443.828333:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789302443.828336:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789302443.828338:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789302443.832221:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+9:14886:x1876219101565568:12345-192.168.203.9@tcp:256:mount.lustre.0 Request processed in 3939us (4522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302443.832243:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 125 00000100:00100000:0.0:1789302443.839545:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302443.839673:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101565696 00000100:00100000:1.0:1789302443.839687:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101565696 00000100:00100000:1.0:1789302443.839812:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 126 00000100:00100000:1.0:1789302443.839825:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adf5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+9:14886:x1876219101565696:12345-192.168.203.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789302443.839850:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302443.839875:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166e000/0x1ff82925bd39a8ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5e41 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302443.839915:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166e000/0x1ff82925bd39a8ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e41 expref: 10 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302443.839960:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166e000/0x1ff82925bd39a8ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e41 expref: 10 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302443.839972:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166e000, rc 0) 00000100:00100000:1.0:1789302443.840373:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adf5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+10:14886:x1876219101565696:12345-192.168.203.9@tcp:101:mount.lustre.0 Request processed in 548us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302443.840383:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 126 00000100:00100000:2.0:1789302443.846986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302443.847160:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101565824 00000100:00100000:0.0:1789302443.847192:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101565824 00000100:00100000:0.0:1789302443.847277:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 127 00000100:00100000:0.0:1789302443.847291:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+10:14886:x1876219101565824:12345-192.168.203.9@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789302443.847498:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adf58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+10:14886:x1876219101565824:12345-192.168.203.9@tcp:501:mount.lustre.0 Request processed in 209us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302443.847506:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 127 00000100:00100000:0.0:1789302443.851276:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302443.853085:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101565952 00000100:00100000:1.0:1789302443.853168:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101565952 00000100:00100000:1.0:1789302443.853250:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 128 00000100:00100000:1.0:1789302443.853262:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+10:14886:x1876219101565952:12345-192.168.203.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789302443.854322:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+10:14886:x1876219101565952:12345-192.168.203.9@tcp:503:mount.lustre.0 Request processed in 200us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302443.854335:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 128 00000100:00100000:1.0:1789302443.863566:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302443.864530:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101566080 00000100:00100000:3.0:1789302443.864547:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101566080 00000100:00100000:3.0:1789302443.864632:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 129 00000100:00100000:3.0:1789302443.864648:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+10:14910:x1876219101566080:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789302443.865381:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+10:14910:x1876219101566080:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 730us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302443.865394:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 129 00000100:00100000:2.0:1789302443.871573:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302443.871696:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101566208 00000100:00100000:1.0:1789302443.871711:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101566208 00000100:00100000:1.0:1789302443.871805:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 130 00000100:00100000:1.0:1789302443.871818:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+10:14910:x1876219101566208:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789302443.872048:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+10:14910:x1876219101566208:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 232us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302443.872057:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 130 00000100:00100000:0.0:1789302443.887386:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302443.887830:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302443.889776:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101566336 00000100:00100000:2.0:1789302443.889808:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101566336 00000100:00100000:2.0:1789302443.889879:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101566592 00000100:00100000:2.0:1789302443.889883:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101566592 00000100:00100000:2.0:1789302443.889923:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:2.0:1789302443.889935:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1876219101566336:12345-192.168.203.9@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789302443.889982:0:17112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 9f958801-6e12-44ad-8390-fe02a2305ca5@192.168.203.9@tcp t0 exp 0000000000000000 cur 519 last 0 00000100:00100000:1.0:1789302443.890255:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 8 00000100:00100000:1.0:1789302443.890262:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1876219101566592:12345-192.168.203.9@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789302443.890304:0:18366:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 9f958801-6e12-44ad-8390-fe02a2305ca5@192.168.203.9@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:1.0:1789302443.890360:0:18366:0:(genops.c:1384:class_connect()) connect: client 9f958801-6e12-44ad-8390-fe02a2305ca5, cookie 0x1ff82925bd39a8fd 00000004:00100000:1.0:1789302443.890402:0:18366:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789302443.890708:0:18366:0:(import.c:65:import_set_state_nolock()) ffff8cc484fbd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302443.890831:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+6:2395:x1876219101566592:12345-192.168.203.9@tcp:38:mount.lustre.0 Request processed in 566us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302443.890842:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 8 00000020:00000080:2.0:1789302443.891394:0:17112:0:(genops.c:1384:class_connect()) connect: client 9f958801-6e12-44ad-8390-fe02a2305ca5, cookie 0x1ff82925bd39a8f6 00000004:00100000:2.0:1789302443.891419:0:17112:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789302443.891653:0:17112:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e51800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302443.891694:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+6:2395:x1876219101566336:12345-192.168.203.9@tcp:38:mount.lustre.0 Request processed in 1759us (4325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302443.891703:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:2.0:1789302443.922719:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302443.922771:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302443.928177:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101566848 00000100:00100000:3.0:1789302443.928199:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101566848 00000100:00100000:3.0:1789302443.928305:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101566464 00000100:00100000:3.0:1789302443.928309:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101566464 00000100:00100000:3.0:1789302443.928344:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 9 00000100:00100000:3.0:1789302443.928356:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+7:14886:x1876219101566848:12345-192.168.203.9@tcp:41:mount.lustre.0 00000100:00100000:0.0:1789302443.929047:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 10 00000100:00100000:0.0:1789302443.929067:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+7:0:x1876219101566464:12345-192.168.203.9@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789302443.929150:0:17112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789302443.929284:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+7:0:x1876219101566464:12345-192.168.203.9@tcp:41:mount.lustre.0 Request processed in 224us (6510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302443.929292:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 10 00000004:00000024:3.0:1789302443.930232:0:17111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789302443.930303:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14886:x1876219101566848:12345-192.168.203.9@tcp:41:mount.lustre.0 Request processed in 1945us (7598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302443.930314:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 9 00000100:00080000:2.0:1789302443.931497:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302443.939735:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302443.940163:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101566720 00000100:00100000:0.0:1789302443.940178:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101566720 00000100:00100000:0.0:1789302443.940274:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 11 00000100:00100000:0.0:1789302443.940288:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+6:0:x1876219101566720:12345-192.168.203.9@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789302443.940341:0:17112:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789302443.940466:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+6:0:x1876219101566720:12345-192.168.203.9@tcp:41:mount.lustre.0 Request processed in 181us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302443.940474:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 11 00000100:00080000:2.0:1789302443.943262:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789302443.946032:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302443.946146:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101566976 00000100:00100000:3.0:1789302443.946160:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101566976 00000100:00100000:3.0:1789302443.946236:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:3.0:1789302443.946249:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14886:x1876219101566976:12345-192.168.203.9@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789302443.946379:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14886:x1876219101566976:12345-192.168.203.9@tcp:40:mount.lustre.0 Request processed in 132us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302443.946387:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:1.0:1789302443.951831:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302443.952334:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101567360 00000100:00100000:3.0:1789302443.952351:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101567360 00000100:00100000:3.0:1789302443.952475:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:3.0:1789302443.952487:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14886:x1876219101567360:12345-192.168.203.9@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789302443.952604:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14886:x1876219101567360:12345-192.168.203.9@tcp:900:mount.lustre.0 Request processed in 118us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302443.952620:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:2.0:1789302443.956478:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302443.956523:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302443.956631:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302443.956798:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101567104 00000100:00100000:0.0:1789302443.956829:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101567104 00000100:00100000:0.0:1789302443.956883:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101567232 00000100:00100000:0.0:1789302443.956887:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101567232 00000100:00100000:0.0:1789302443.956908:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:0.0:1789302443.956917:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1876219101567104:12345-192.168.203.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789302443.956964:0:18618:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9f958801-6e12-44ad-8390-fe02a2305ca5@192.168.203.9@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:0.0:1789302443.957002:0:18618:0:(genops.c:1384:class_connect()) connect: client 9f958801-6e12-44ad-8390-fe02a2305ca5, cookie 0x1ff82925bd39a904 00002000:00100000:0.0:1789302443.957016:0:18618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9f958801-6e12-44ad-8390-fe02a2305ca5/ffff8cc4b520f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789302443.957031:0:18618:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789302443.957303:0:18618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789302443.957363:0:18618:0:(import.c:65:import_set_state_nolock()) ffff8cc4bc42d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302443.957453:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+6:2395:x1876219101567104:12345-192.168.203.9@tcp:8:mount.lustre.0 Request processed in 534us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302443.957463:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:0.0:1789302443.957489:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:0.0:1789302443.957495:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1876219101567232:12345-192.168.203.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789302443.957515:0:18618:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9f958801-6e12-44ad-8390-fe02a2305ca5@192.168.203.9@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:0.0:1789302443.957537:0:18618:0:(genops.c:1384:class_connect()) connect: client 9f958801-6e12-44ad-8390-fe02a2305ca5, cookie 0x1ff82925bd39a90b 00002000:00100000:0.0:1789302443.957544:0:18618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9f958801-6e12-44ad-8390-fe02a2305ca5/ffff8cc4bc429000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789302443.957561:0:18618:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789302443.957723:0:18618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789302443.957740:0:18618:0:(import.c:65:import_set_state_nolock()) ffff8cc4bc42a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302443.957768:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+6:2395:x1876219101567232:12345-192.168.203.9@tcp:8:mount.lustre.0 Request processed in 272us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302443.957776:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:1.0:1789302443.958108:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101567488 00000100:00100000:1.0:1789302443.958151:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101567488 00000100:00100000:1.0:1789302443.958192:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 0 00000100:00100000:1.0:1789302443.958200:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14886:x1876219101567488:12345-192.168.203.9@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789302443.962758:0:17113:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4458us 00000004:00200000:0.0:1789302443.983898:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789302443.984086:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14886:x1876219101567488:12345-192.168.203.9@tcp:33:mount.lustre.0 Request processed in 25878us (27445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302443.984136:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 0 00000100:00100000:1.0:1789302444.116560:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302444.116592:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121579648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302444.116689:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302444.116771:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121579648 00000100:00100000:1.0:1789302444.116781:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121579648 00000100:00100000:1.0:1789302444.116843:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789302444.116854:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121579648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789302444.116899:0:17850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789302444.116956:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121579648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302444.116964:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789302444.117286:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121579648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302444.118789:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302444.118815:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121579776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302444.118940:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302444.119176:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121579776 00000100:00100000:0.0:1789302444.119188:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121579776 00000100:00100000:0.0:1789302444.119247:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789302444.119259:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc381f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121579776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789302444.119304:0:17116:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789302444.119363:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc381f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121579776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302444.119371:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789302444.119945:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121579776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302444.225694:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302444.225819:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101567616 00000100:00100000:0.0:1789302444.225829:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101567616 00000100:00100000:0.0:1789302444.225890:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:0.0:1789302444.225901:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14933:x1876219101567616:12345-192.168.203.9@tcp:101:mkdir.0 00010000:00010000:0.0:1789302444.225921:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302444.225949:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e000/0x1ff82925bd39a912 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5e72 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.226024:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39a919 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.226037:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39a919 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.226053:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39a919 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302444.226159:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789302444.226163:0:17112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789302444.226200:0:17112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39a919 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.226228:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e000/0x1ff82925bd39a912 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e72 expref: 8 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.226258:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39a919 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e72 expref: 7 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.226266:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa6100) 00010000:00010000:0.0:1789302444.226269:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302444.226273:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538fc00, rc 0) 00000100:00100000:0.0:1789302444.226336:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+7:14933:x1876219101567616:12345-192.168.203.9@tcp:101:mkdir.0 Request processed in 437us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302444.226343:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 13 00010000:00010000:1.0:1789302444.568534:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302444.884897:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789302445.594519:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302445.654595:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121580160:0@lo:400:kworker.0 00000100:00100000:3.0:1789302445.654767:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302445.654853:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121580672:0@lo:400:kworker.0 00000100:00100000:2.0:1789302445.654875:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121580160 00000100:00100000:3.0:1789302445.654883:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302445.654885:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121580160 00000100:00100000:1.0:1789302445.654909:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121580288:0@lo:400:kworker.0 00000100:00100000:3.0:1789302445.654915:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121581184:0@lo:400:kworker.0 00000100:00100000:2.0:1789302445.654963:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121580672 00000100:00100000:3.0:1789302445.654968:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302445.654969:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121580672 00000100:00100000:2.0:1789302445.655001:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302445.655003:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789302445.655016:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302445.655018:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121580160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302445.655022:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121580032:0@lo:400:kworker.0 00000100:00100000:3.0:1789302445.655069:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302445.655072:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121580800:0@lo:400:kworker.0 00000100:00100000:3.0:1789302445.655488:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121580544:0@lo:400:kworker.0 00000100:00100000:0.0:1789302445.658345:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121581184 00000100:00100000:0.0:1789302445.658365:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121581184 00000100:00100000:0.0:1789302445.658811:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789302445.658827:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121581184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.659631:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302445.659677:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121580160:12345-0@lo:400:kworker.0 Request processed in 4657us (4899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302445.659693:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789302445.659699:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121581312:0@lo:400:kworker.0 00000100:00100000:2.0:1789302445.659737:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121580288 00000100:00100000:2.0:1789302445.659761:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121580288 00000100:00100000:1.0:1789302445.659766:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302445.659806:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121580800 00000100:00100000:2.0:1789302445.659811:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121580800 00000100:00100000:1.0:1789302445.659821:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789302445.659835:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121579904:0@lo:400:kworker.0 00000100:00100000:2.0:1789302445.659844:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302445.659858:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121580672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.659884:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302445.659924:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121579904 00000100:00100000:1.0:1789302445.659930:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121579904 00000100:00100000:2.0:1789302445.659972:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121580672:12345-0@lo:400:kworker.0 Request processed in 116us (5088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302445.659982:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789302445.659993:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789302445.660006:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302445.660008:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:3647:x1876219121579904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302445.660024:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121580288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660062:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:3647:x1876219121579904:12345-0@lo:400:kworker.0 Request processed in 58us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302445.660071:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789302445.660138:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876219121580288:12345-0@lo:400:kworker.0 Request processed in 94us (5103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302445.660148:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302445.660157:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121581312 00000100:00100000:1.0:1789302445.660163:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121581312 00000100:00100000:2.0:1789302445.660173:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302445.660184:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121580800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660206:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789302445.660218:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121581312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302445.660228:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121580800:12345-0@lo:400:kworker.0 Request processed in 43us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302445.660236:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789302445.660274:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121581312:12345-0@lo:400:kworker.0 Request processed in 57us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302445.660282:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789302445.660336:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302445.660342:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302445.660344:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789302445.660347:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302445.660354:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121579904:0@lo:400:kworker.0 00000100:00100000:2.0:1789302445.660381:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121581568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302445.660387:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121580416:0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660453:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302445.660475:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121580928:0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660498:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302445.660520:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121580416 00000100:00100000:1.0:1789302445.660524:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121580416 00000100:00100000:1.0:1789302445.660543:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121580928 00000100:00100000:1.0:1789302445.660546:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121580928 00000100:00100000:1.0:1789302445.660559:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789302445.660565:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121580416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660595:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121580416:12345-0@lo:400:kworker.0 Request processed in 30us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302445.660601:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789302445.660614:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789302445.660620:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121580928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660646:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121580928:12345-0@lo:400:kworker.0 Request processed in 26us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302445.660652:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789302445.660680:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121580928:0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660688:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121581440:0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660717:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302445.660737:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121581440 00000100:00100000:1.0:1789302445.660740:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121581440 00000100:00100000:1.0:1789302445.660772:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789302445.660778:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121581440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660821:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121581440:12345-0@lo:400:kworker.0 Request processed in 43us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302445.660828:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789302445.660858:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383456d80 x1876219121581440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302445.660870:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121581440:0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660886:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121580288:0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660898:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121580800:0@lo:400:kworker.0 00000100:00100000:2.0:1789302445.660906:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302445.660918:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121581312:0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.660983:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121580416:0@lo:400:kworker.0 00000100:00100000:2.0:1789302445.660987:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121581568 00000100:00100000:2.0:1789302445.660996:0:18620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121581568 00000100:00100000:2.0:1789302445.661062:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789302445.661073:0:18620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876219121581568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302445.661144:0:18620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789302445.661197:0:18620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876219121581568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302445.661205:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789302445.661229:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789302445.661265:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121581568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302445.661280:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302445.661288:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc498ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121581696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302445.661330:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302445.661402:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121580032 00000100:00100000:2.0:1789302445.661407:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121580032 00000100:00100000:2.0:1789302445.661436:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789302445.661444:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121580032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.661554:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121581696 00000100:00100000:1.0:1789302445.661561:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121581696 00000100:00100000:1.0:1789302445.661597:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302445.661605:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121581696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789302445.661623:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789302445.661797:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121581696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 193us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302445.661805:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789302445.662271:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121580032:12345-0@lo:400:kworker.0 Request processed in 824us (7199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302445.662280:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789302445.662334:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc498ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121581696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302445.664108:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302445.664156:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121581184:12345-0@lo:400:kworker.0 Request processed in 5323us (9177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302445.664174:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789302445.664473:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121581056:0@lo:400:kworker.0 00000100:00100000:3.0:1789302445.664509:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302445.664562:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121580160:0@lo:400:kworker.0 00000100:00100000:3.0:1789302445.664598:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121580672:0@lo:400:kworker.0 00010000:00080000:3.0:1789302445.664612:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc383456300 x1876219121581184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302445.664623:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121581184:0@lo:400:kworker.0 00000100:00100000:3.0:1789302445.664649:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121580032:0@lo:400:kworker.0 00000100:00100000:2.0:1789302445.664728:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121581056 00000100:00100000:2.0:1789302445.664736:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121581056 00000100:00100000:2.0:1789302445.664805:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789302445.664814:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121581056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302445.664864:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121581056:12345-0@lo:400:kworker.0 Request processed in 51us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302445.664870:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789302445.664932:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302445.664967:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121581056:0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.665302:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121580544 00000100:00100000:1.0:1789302445.665307:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121580544 00000100:00100000:1.0:1789302445.665345:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789302445.665352:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121580544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302445.665443:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121580544:12345-0@lo:400:kworker.0 Request processed in 91us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302445.665459:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789302445.665558:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121580544:0@lo:400:kworker.0 00000001:00100000:0.0:1789302445.666266:0:19430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9f958801-6e12-44ad-8390-fe02a2305ca5 00000001:00080000:0.0:1789302445.666277:0:19430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:3.0:1789302446.383900:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.383984:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101567744 00000100:00100000:1.0:1789302446.383995:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101567744 00000100:00100000:1.0:1789302446.384065:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00100000:1.0:1789302446.384075:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+7:14985:x1876219101567744:12345-192.168.203.9@tcp:41:lfs.0 00000004:00000024:1.0:1789302446.384144:0:18366:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789302446.384223:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+7:14985:x1876219101567744:12345-192.168.203.9@tcp:41:lfs.0 Request processed in 149us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.384230:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00080000:3.0:1789302446.384552:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302446.394106:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302446.394229:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101567872 00000100:00100000:2.0:1789302446.394239:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101567872 00000100:00100000:2.0:1789302446.394313:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00100000:2.0:1789302446.394324:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14985:x1876219101567872:12345-192.168.203.9@tcp:41:lfs.0 00000004:00000024:2.0:1789302446.394360:0:17111:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789302446.394456:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14985:x1876219101567872:12345-192.168.203.9@tcp:41:lfs.0 Request processed in 134us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302446.394465:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00080000:3.0:1789302446.395726:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789302446.399721:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302446.399830:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101568000 00000100:00100000:0.0:1789302446.399839:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101568000 00000100:00100000:0.0:1789302446.399927:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 11 00000100:00100000:0.0:1789302446.399938:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14985:x1876219101568000:12345-192.168.203.9@tcp:13:lfs.0 00002000:00000024:0.0:1789302446.399970:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789302446.400063:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9f958801-6e12-44ad-8390-fe02a2305ca5+6:14985:x1876219101568000:12345-192.168.203.9@tcp:13:lfs.0 Request processed in 127us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302446.400070:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 11 00000100:00080000:3.0:1789302446.400302:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302446.409924:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302446.410557:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101568128 00000100:00100000:0.0:1789302446.410567:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101568128 00000100:00100000:0.0:1789302446.410690:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:0.0:1789302446.410700:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9f958801-6e12-44ad-8390-fe02a2305ca5+5:14985:x1876219101568128:12345-192.168.203.9@tcp:13:lfs.0 00002000:00000024:0.0:1789302446.410726:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789302446.410816:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9f958801-6e12-44ad-8390-fe02a2305ca5+5:14985:x1876219101568128:12345-192.168.203.9@tcp:13:lfs.0 Request processed in 117us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302446.410824:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00080000:3.0:1789302446.412430:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789302446.614415:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302446.705694:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302446.705881:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101568256 00000100:00100000:3.0:1789302446.705891:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101568256 00000100:00100000:3.0:1789302446.705950:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 132 00000100:00100000:3.0:1789302446.705960:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+10:15018:x1876219101568256:12345-192.168.203.9@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789302446.705975:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302446.706002:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5e79 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302446.706032:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e79 expref: 11 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302446.706043:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa983000/0x1ff82925bd39a920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e79 expref: 11 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302446.706068:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983000, rc 0) 00000100:00100000:3.0:1789302446.706167:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+11:15018:x1876219101568256:12345-192.168.203.9@tcp:101:mount.lustre.0 Request processed in 207us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302446.706174:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 132 00000100:00100000:2.0:1789302446.712214:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.712334:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101568384 00000100:00100000:1.0:1789302446.712343:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101568384 00000100:00100000:1.0:1789302446.712395:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 133 00000100:00100000:1.0:1789302446.712405:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+11:15018:x1876219101568384:12345-192.168.203.9@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789302446.712561:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+11:15018:x1876219101568384:12345-192.168.203.9@tcp:501:mount.lustre.0 Request processed in 157us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.712570:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 133 00000100:00100000:2.0:1789302446.722664:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.724596:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101568512 00000100:00100000:1.0:1789302446.724612:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101568512 00000100:00100000:1.0:1789302446.724684:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 134 00000100:00100000:1.0:1789302446.724694:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+11:15018:x1876219101568512:12345-192.168.203.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789302446.724864:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+11:15018:x1876219101568512:12345-192.168.203.9@tcp:503:mount.lustre.0 Request processed in 170us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.724879:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 134 00000100:00100000:2.0:1789302446.754736:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302446.754907:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101568640 00000100:00100000:3.0:1789302446.754916:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101568640 00000100:00100000:3.0:1789302446.754974:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 135 00000100:00100000:3.0:1789302446.754985:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+11:15022:x1876219101568640:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789302446.755174:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+11:15022:x1876219101568640:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 190us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302446.755182:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 135 00000100:00100000:3.0:1789302446.818320:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.818461:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101568768 00000100:00100000:1.0:1789302446.818470:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101568768 00000100:00100000:1.0:1789302446.818528:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 136 00000100:00100000:1.0:1789302446.818538:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+11:15022:x1876219101568768:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789302446.818694:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+11:15022:x1876219101568768:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 156us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.818702:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 136 00000100:00100000:2.0:1789302446.824921:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.825018:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101568896 00000100:00100000:1.0:1789302446.825028:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101568896 00000100:00100000:1.0:1789302446.825091:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 137 00000100:00100000:1.0:1789302446.825101:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+11:15022:x1876219101568896:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789302446.825274:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+11:15022:x1876219101568896:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 174us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.825282:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 137 00000100:00100000:0.0:1789302446.832033:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302446.832138:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101569024 00000100:00100000:3.0:1789302446.832148:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101569024 00000100:00100000:3.0:1789302446.832202:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 138 00000100:00100000:3.0:1789302446.832212:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+11:15018:x1876219101569024:12345-192.168.203.9@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789302446.832229:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302446.832247:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a927 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5eaa expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302446.832277:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5eaa expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302446.832288:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa983400/0x1ff82925bd39a927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5eaa expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302446.832316:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983400, rc 0) 00000100:00100000:3.0:1789302446.832374:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+12:15018:x1876219101569024:12345-192.168.203.9@tcp:101:mount.lustre.0 Request processed in 164us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302446.832381:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 138 00000100:00100000:3.0:1789302446.848060:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302446.848222:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101569152 00000100:00100000:2.0:1789302446.848232:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101569152 00000100:00100000:2.0:1789302446.848288:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 139 00000100:00100000:2.0:1789302446.848298:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+12:15018:x1876219101569152:12345-192.168.203.9@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789302446.848322:0:17102:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789302446.848346:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789302446.848350:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789302446.848354:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789302446.848356:0:17102:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789302446.848359:0:17102:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789302446.851846:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+12:15018:x1876219101569152:12345-192.168.203.9@tcp:256:mount.lustre.0 Request processed in 3537us (3783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.851861:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 139 00000100:00100000:0.0:1789302446.864222:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.864584:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101569280 00000100:00100000:1.0:1789302446.864593:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101569280 00000100:00100000:1.0:1789302446.864654:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 140 00000100:00100000:1.0:1789302446.864664:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+12:15018:x1876219101569280:12345-192.168.203.9@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789302446.864679:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302446.864696:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166f600/0x1ff82925bd39a92e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5eb1 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302446.864744:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166f600/0x1ff82925bd39a92e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5eb1 expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302446.864755:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166f600/0x1ff82925bd39a92e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5eb1 expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302446.865941:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f600, rc 0) 00000100:00100000:1.0:1789302446.866088:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+13:15018:x1876219101569280:12345-192.168.203.9@tcp:101:mount.lustre.0 Request processed in 1414us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.866096:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 140 00000100:00100000:3.0:1789302446.877291:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.879029:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101569408 00000100:00100000:1.0:1789302446.879043:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101569408 00000100:00100000:1.0:1789302446.879142:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 141 00000100:00100000:1.0:1789302446.879152:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+13:15018:x1876219101569408:12345-192.168.203.9@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789302446.879307:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+13:15018:x1876219101569408:12345-192.168.203.9@tcp:501:mount.lustre.0 Request processed in 155us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.879315:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 141 00000100:00100000:2.0:1789302446.881709:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.882401:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101569536 00000100:00100000:1.0:1789302446.882413:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101569536 00000100:00100000:1.0:1789302446.882477:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 142 00000100:00100000:1.0:1789302446.882486:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+13:15018:x1876219101569536:12345-192.168.203.9@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789302446.882624:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+13:15018:x1876219101569536:12345-192.168.203.9@tcp:503:mount.lustre.0 Request processed in 138us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.882631:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 142 00000100:00100000:0.0:1789302446.892269:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302446.893185:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101569664 00000100:00100000:3.0:1789302446.893197:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101569664 00000100:00100000:3.0:1789302446.893255:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 143 00000100:00100000:3.0:1789302446.893265:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+13:15029:x1876219101569664:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789302446.893429:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+13:15029:x1876219101569664:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 164us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302446.893437:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 143 00000100:00100000:3.0:1789302446.898481:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302446.906390:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101569792 00000100:00100000:2.0:1789302446.906407:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101569792 00000100:00100000:2.0:1789302446.906544:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 144 00000100:00100000:2.0:1789302446.906557:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+13:15029:x1876219101569792:12345-192.168.203.9@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789302446.906745:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+13:15029:x1876219101569792:12345-192.168.203.9@tcp:502:llog_process_th.0 Request processed in 189us (8271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302446.906753:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 144 00000100:00100000:2.0:1789302446.921838:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.922027:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101569920 00000100:00100000:1.0:1789302446.922049:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101569920 00000100:00100000:1.0:1789302446.922102:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00100000:1.0:1789302446.922137:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1876219101569920:12345-192.168.203.9@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789302446.922167:0:18366:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0c39c9e8-9b50-402e-a4e7-1190d400118d@192.168.203.9@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:1.0:1789302446.922206:0:18366:0:(genops.c:1384:class_connect()) connect: client 0c39c9e8-9b50-402e-a4e7-1190d400118d, cookie 0x1ff82925bd39a935 00000004:00100000:1.0:1789302446.922230:0:18366:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789302446.922318:0:18366:0:(import.c:65:import_set_state_nolock()) ffff8cc4b511b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302446.922384:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2395:x1876219101569920:12345-192.168.203.9@tcp:38:mount.lustre.0 Request processed in 272us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.922391:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00100000:1.0:1789302446.929797:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302446.929920:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101570176 00000100:00100000:2.0:1789302446.929930:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101570176 00000100:00100000:2.0:1789302446.929984:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:2.0:1789302446.929994:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1876219101570176:12345-192.168.203.9@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789302446.930025:0:17111:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 0c39c9e8-9b50-402e-a4e7-1190d400118d@192.168.203.9@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:2.0:1789302446.930076:0:17111:0:(genops.c:1384:class_connect()) connect: client 0c39c9e8-9b50-402e-a4e7-1190d400118d, cookie 0x1ff82925bd39a93c 00000004:00100000:2.0:1789302446.930141:0:17111:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789302446.930233:0:17111:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e54800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302446.930296:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2395:x1876219101570176:12345-192.168.203.9@tcp:38:mount.lustre.0 Request processed in 302us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302446.930303:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:3.0:1789302446.931024:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302446.931059:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.931137:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101570432 00000100:00100000:1.0:1789302446.931142:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101570432 00000100:00100000:1.0:1789302446.931200:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101570048 00000100:00100000:1.0:1789302446.931205:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101570048 00000100:00100000:1.0:1789302446.931225:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:1.0:1789302446.931233:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bd802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+7:15018:x1876219101570432:12345-192.168.203.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789302446.931256:0:18366:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789302446.931320:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bd802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+7:15018:x1876219101570432:12345-192.168.203.9@tcp:41:mount.lustre.0 Request processed in 87us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.931327:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:1.0:1789302446.931343:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00100000:1.0:1789302446.931349:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:0:x1876219101570048:12345-192.168.203.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789302446.931360:0:18366:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789302446.931382:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:0:x1876219101570048:12345-192.168.203.9@tcp:41:mount.lustre.0 Request processed in 33us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.931398:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00080000:3.0:1789302446.931574:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302446.942284:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.942396:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302446.943216:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101570304 00000100:00100000:2.0:1789302446.943228:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101570304 00000100:00100000:0.0:1789302446.943235:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101570560 00000100:00100000:0.0:1789302446.943242:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101570560 00000100:00100000:0.0:1789302446.943338:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:0.0:1789302446.943349:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:15018:x1876219101570560:12345-192.168.203.9@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789302446.943508:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:15018:x1876219101570560:12345-192.168.203.9@tcp:40:mount.lustre.0 Request processed in 160us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302446.943516:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00080000:2.0:1789302446.943953:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789302446.944106:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:1.0:1789302446.944138:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:0:x1876219101570304:12345-192.168.203.9@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789302446.944156:0:18366:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789302446.944212:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:0:x1876219101570304:12345-192.168.203.9@tcp:41:mount.lustre.0 Request processed in 98us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.944220:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:1.0:1789302446.953685:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302446.953811:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101570944 00000100:00100000:3.0:1789302446.953822:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101570944 00000100:00100000:3.0:1789302446.953882:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4 00000100:00100000:3.0:1789302446.953894:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:15018:x1876219101570944:12345-192.168.203.9@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789302446.953976:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:15018:x1876219101570944:12345-192.168.203.9@tcp:900:mount.lustre.0 Request processed in 84us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302446.953984:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4 00000100:00100000:3.0:1789302446.955259:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302446.955301:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302446.955799:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101570688 00000100:00100000:2.0:1789302446.955809:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101570688 00000100:00100000:2.0:1789302446.955890:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101570816 00000100:00100000:2.0:1789302446.955895:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101570816 00000100:00100000:2.0:1789302446.955926:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:2.0:1789302446.955933:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1876219101570688:12345-192.168.203.9@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789302446.955963:0:18618:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0c39c9e8-9b50-402e-a4e7-1190d400118d@192.168.203.9@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:2.0:1789302446.956001:0:18618:0:(genops.c:1384:class_connect()) connect: client 0c39c9e8-9b50-402e-a4e7-1190d400118d, cookie 0x1ff82925bd39a943 00002000:00100000:2.0:1789302446.956011:0:18618:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0c39c9e8-9b50-402e-a4e7-1190d400118d/ffff8cc4b7e56000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789302446.956021:0:18618:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789302446.956106:0:18618:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789302446.956159:0:18618:0:(import.c:65:import_set_state_nolock()) ffff8cc4b7e52000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302446.956218:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2395:x1876219101570688:12345-192.168.203.9@tcp:8:mount.lustre.0 Request processed in 282us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302446.956225:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:0.0:1789302446.956233:0:18617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc484fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1876219101570816:12345-192.168.203.9@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789302446.956260:0:18617:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0c39c9e8-9b50-402e-a4e7-1190d400118d@192.168.203.9@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:0.0:1789302446.956284:0:18617:0:(genops.c:1384:class_connect()) connect: client 0c39c9e8-9b50-402e-a4e7-1190d400118d, cookie 0x1ff82925bd39a94a 00002000:00100000:0.0:1789302446.956289:0:18617:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0c39c9e8-9b50-402e-a4e7-1190d400118d/ffff8cc4bc42b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789302446.956296:0:18617:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789302446.956345:0:18617:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789302446.956363:0:18617:0:(import.c:65:import_set_state_nolock()) ffff8cc4bc428800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302446.956393:0:18617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc484fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2395:x1876219101570816:12345-192.168.203.9@tcp:8:mount.lustre.0 Request processed in 154us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.958322:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302446.958382:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101571072 00000100:00100000:1.0:1789302446.958390:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101571072 00000100:00100000:1.0:1789302446.959899:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1 00000100:00100000:1.0:1789302446.959915:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:15018:x1876219101571072:12345-192.168.203.9@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789302446.959999:0:17114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789302446.960090:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:15018:x1876219101571072:12345-192.168.203.9@tcp:33:mount.lustre.0 Request processed in 170us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302446.960099:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1 00000100:00100000:2.0:1789302446.960252:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:0.0:1789302446.960263:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:1.0:1789302447.205609:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302447.205770:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101571200 00000100:00100000:0.0:1789302447.205780:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101571200 00000100:00100000:0.0:1789302447.205844:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:0.0:1789302447.205855:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:15052:x1876219101571200:12345-192.168.203.9@tcp:101:mkdir.0 00010000:00010000:0.0:1789302447.205874:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302447.205893:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f800/0x1ff82925bd39a951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ee2 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302447.205958:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302447.205971:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302447.205984:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302447.206072:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789302447.206076:0:17112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789302447.206106:0:17112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302447.206166:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f800/0x1ff82925bd39a951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ee2 expref: 8 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302447.206185:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ee2 expref: 7 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302447.206193:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa6100) 00010000:00010000:0.0:1789302447.206196:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302447.206199:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538e800, rc 0) 00000100:00100000:0.0:1789302447.206264:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c39c9e8-9b50-402e-a4e7-1190d400118d+7:15052:x1876219101571200:12345-192.168.203.9@tcp:101:mkdir.0 Request processed in 411us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302447.206280:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 22 00010000:00010000:3.0:1789302447.636296:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302447.700759:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121581824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302447.700830:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302447.700966:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121581824 00000100:00100000:0.0:1789302447.700975:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121581824 00000100:00100000:0.0:1789302447.701110:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302447.701151:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121581824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302447.701190:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789302447.701287:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121581824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302447.701294:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789302447.709440:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302447.710086:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121581824:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789302448.661302:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302448.726239:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302448.726262:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121581952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302448.726340:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302448.729685:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121581952 00000100:00100000:0.0:1789302448.729701:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121581952 00000100:00080000:2.0:1789302448.729791:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302448.729796:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302448.729809:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121581952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302448.729842:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789302448.729927:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121581952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (3586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302448.729934:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789302448.730007:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121581952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302449.236619:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302449.236643:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121582080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302449.236723:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302449.236879:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121582080 00000100:00100000:0.0:1789302449.236888:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121582080 00000100:00100000:0.0:1789302449.236943:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789302449.236953:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121582080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789302449.236996:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789302449.237057:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121582080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302449.237074:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789302449.237140:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121582080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789302449.237461:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121582208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302449.237492:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302449.238815:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121582208 00000100:00100000:2.0:1789302449.238825:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121582208 00000100:00100000:2.0:1789302449.238874:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789302449.238884:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121582208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302449.238914:0:17116:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789302449.238991:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121582208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302449.238998:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789302449.239464:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121582208:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789302449.690585:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789302449.758525:0:18613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c39c9e8-9b50-402e-a4e7-1190d400118d 00000001:00100000:0.0:1789302449.758536:0:18613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9f958801-6e12-44ad-8390-fe02a2305ca5 00000001:00100000:3.0:1789302449.759477:0:17090:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0c39c9e8-9b50-402e-a4e7-1190d400118d 00000001:00100000:3.0:1789302449.759485:0:17090:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9f958801-6e12-44ad-8390-fe02a2305ca5 00000001:00100000:1.0:1789302449.760355:0:17842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0c39c9e8-9b50-402e-a4e7-1190d400118d 00000001:00100000:1.0:1789302449.760373:0:17842:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9f958801-6e12-44ad-8390-fe02a2305ca5 00000040:00080000:3.0:1789302450.136521:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1789302450.665693:0:19985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789302450.709568:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302450.772337:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121582336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302450.772416:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302450.772491:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121582336 00000100:00100000:2.0:1789302450.772498:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121582336 00000100:00100000:2.0:1789302450.772799:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789302450.772811:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121582336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302450.772842:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789302450.772885:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121582336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302450.772892:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789302450.772914:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302450.772928:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121582464:0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.772961:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302450.773183:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121582848:0@lo:400:kworker.0 00000100:00100000:3.0:1789302450.773216:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302450.774671:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121582592:0@lo:400:kworker.0 00000100:00100000:0.0:1789302450.774722:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302450.774794:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121582592 00000100:00100000:1.0:1789302450.774802:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121582592 00000100:00100000:1.0:1789302450.774848:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789302450.774856:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121582592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302450.774903:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121582592:12345-0@lo:400:kworker.0 Request processed in 48us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302450.774910:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789302450.775093:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121582976:0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.775140:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302450.775173:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121583488:0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.775200:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302450.775225:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121584000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302450.775248:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302450.775280:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121582464 00000100:00100000:2.0:1789302450.775285:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121582464 00000100:00100000:2.0:1789302450.775315:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789302450.775322:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:3648:x1876219121582464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.775360:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:3648:x1876219121582464:12345-0@lo:400:kworker.0 Request processed in 38us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302450.775366:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789302450.775406:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121582848 00000100:00100000:2.0:1789302450.775410:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121582848 00000100:00100000:2.0:1789302450.775437:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121583488 00000100:00100000:2.0:1789302450.775440:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121583488 00000100:00100000:2.0:1789302450.775468:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789302450.775474:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121582848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.775505:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121582848:12345-0@lo:400:kworker.0 Request processed in 32us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302450.775511:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789302450.775524:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789302450.775541:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121583488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.775569:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876219121583488:12345-0@lo:400:kworker.0 Request processed in 40us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302450.775575:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789302450.775592:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121582976 00000100:00100000:2.0:1789302450.775595:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121582976 00000100:00100000:2.0:1789302450.775621:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789302450.775626:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121582976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.775670:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121582976:12345-0@lo:400:kworker.0 Request processed in 43us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302450.775677:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789302450.775708:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302450.775718:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121584000 00000100:00100000:2.0:1789302450.775721:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121584000 00000100:00100000:2.0:1789302450.775858:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302450.775864:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121584000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789302450.775878:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789302450.775909:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121584000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302450.775915:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789302450.775931:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302450.775962:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121584000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789302450.775972:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121582464:0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.775981:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121582976:0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.775989:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876219121583488:0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.776286:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121582848:0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.776295:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121583360:0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.776323:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302450.776352:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121583872:0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.776373:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302450.776419:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789302450.776437:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121582336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302450.776463:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121583360 00000100:00100000:2.0:1789302450.776467:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121583360 00000100:00100000:2.0:1789302450.776491:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121583872 00000100:00100000:2.0:1789302450.776493:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121583872 00000100:00100000:2.0:1789302450.776515:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789302450.776522:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121583360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302450.776648:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789302450.776658:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121583872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302450.776700:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121583872:12345-0@lo:400:kworker.0 Request processed in 45us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302450.776706:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789302450.776746:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc485d51500 x1876219121583872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302450.776758:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121583872:0@lo:400:kworker.0 00000100:00100000:2.0:1789302450.776889:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121583360:12345-0@lo:400:kworker.0 Request processed in 366us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302450.776896:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789302450.776917:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302450.777031:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121583360:0@lo:400:kworker.0 00000100:00100000:1.0:1789302450.777164:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121582720:0@lo:400:kworker.0 00000100:00100000:1.0:1789302450.777198:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302450.777220:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121583232:0@lo:400:kworker.0 00000100:00100000:1.0:1789302450.777240:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302450.777261:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121583744:0@lo:400:kworker.0 00000100:00100000:1.0:1789302450.777282:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302450.777383:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121582720 00000100:00100000:3.0:1789302450.777388:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121582720 00000100:00100000:3.0:1789302450.777441:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121583232 00000100:00100000:3.0:1789302450.777444:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121583232 00000100:00100000:3.0:1789302450.777464:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789302450.777471:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121582720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302450.777518:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121582720:12345-0@lo:400:kworker.0 Request processed in 48us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302450.777524:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789302450.777650:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302450.777672:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121582720:0@lo:400:kworker.0 00000100:00100000:3.0:1789302450.777718:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789302450.777725:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121583232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302450.777838:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121583232:12345-0@lo:400:kworker.0 Request processed in 113us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302450.777844:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789302450.777860:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121583744 00000100:00100000:3.0:1789302450.777864:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121583744 00000100:00100000:3.0:1789302450.777892:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789302450.777897:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121583744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302450.777925:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876219121583744:12345-0@lo:400:kworker.0 Request processed in 28us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302450.777930:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1789302450.777943:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302450.777998:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121583232:0@lo:400:kworker.0 00000100:00100000:1.0:1789302450.778017:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876219121583744:0@lo:400:kworker.0 00000100:00100000:0.0:1789302450.779351:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121582592:0@lo:400:kworker.0 00000100:00100000:0.0:1789302450.779363:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121583104:0@lo:400:kworker.0 00000100:00100000:0.0:1789302450.779478:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302450.779678:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121583616:0@lo:400:kworker.0 00000100:00100000:0.0:1789302450.779705:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302450.779802:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121583616 00000100:00100000:3.0:1789302450.779810:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121583616 00000100:00100000:3.0:1789302450.779858:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789302450.779867:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121583616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302450.779912:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876219121583616:12345-0@lo:400:kworker.0 Request processed in 47us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302450.779918:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789302450.779938:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789302450.782633:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121583104 00000100:00100000:1.0:1789302450.782646:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121583104 00000100:00100000:1.0:1789302450.782710:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302450.782719:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121583104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302450.782909:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121583104:12345-0@lo:400:kworker.0 Request processed in 190us (3431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302450.782916:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789302450.782942:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302450.783262:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121583104:0@lo:400:kworker.0 00010000:00080000:1.0:1789302450.783280:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc384295500 x1876219121583616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302450.783290:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876219121583616:0@lo:400:kworker.0 00010000:00010000:3.0:1789302451.732309:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302452.062996:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302452.063039:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302452.063093:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302452.063148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302452.063171:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101571328 00000100:00100000:2.0:1789302452.063179:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302452.063182:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101571328 00000100:00100000:2.0:1789302452.063201:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302452.063225:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302452.063246:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 146 00000100:00100000:2.0:1789302452.063254:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302452.063261:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+13:2399:x1876219101571328:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302452.063282:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302452.063307:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101571456 00000100:00100000:2.0:1789302452.063312:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101571456 00000100:00100000:1.0:1789302452.063335:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+13:2399:x1876219101571328:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 78us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302452.063344:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 146 00000100:00100000:2.0:1789302452.063351:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101571584 00000100:00100000:2.0:1789302452.063356:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101571584 00000100:00100000:2.0:1789302452.063374:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101572096 00000100:00100000:2.0:1789302452.063377:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101572096 00000100:00100000:1.0:1789302452.063381:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101571840 00000100:00100000:2.0:1789302452.063391:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101571968 00000100:00100000:2.0:1789302452.063394:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101571968 00000100:00100000:1.0:1789302452.063401:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101571840 00000100:00100000:2.0:1789302452.063423:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 50 00000100:00100000:1.0:1789302452.063432:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101572352 00000100:00100000:2.0:1789302452.063433:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+6:2398:x1876219101571456:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302452.063437:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101572352 00000100:00100000:1.0:1789302452.063453:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101571712 00000100:00100000:1.0:1789302452.063463:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101571712 00000100:00100000:2.0:1789302452.063473:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+6:2398:x1876219101571456:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 41us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302452.063481:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101572224 00000100:00100000:2.0:1789302452.063482:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 50 00000100:00100000:1.0:1789302452.063486:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101572224 00000100:00100000:1.0:1789302452.063501:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:1.0:1789302452.063509:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2399:x1876219101571840:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302452.063517:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 51 00000100:00100000:2.0:1789302452.063525:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2399:x1876219101571584:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302452.063540:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2399:x1876219101571840:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 31us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302452.063547:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:2.0:1789302452.063555:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2399:x1876219101571584:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302452.063564:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:2.0:1789302452.063572:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 51 00000100:00100000:1.0:1789302452.063577:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2399:x1876219101572352:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302452.063593:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:1.0:1789302452.063605:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383454700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2399:x1876219101572352:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302452.063606:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2399:x1876219101572096:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302452.063619:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:1.0:1789302452.063632:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00100000:1.0:1789302452.063639:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2398:x1876219101571712:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302452.063652:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2399:x1876219101572096:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 49us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302452.063659:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:1.0:1789302452.063665:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2398:x1876219101571712:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302452.063670:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00100000:1.0:1789302452.063679:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00100000:1.0:1789302452.063684:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2398:x1876219101572224:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302452.063700:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2398:x1876219101572224:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 16us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302452.063705:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00080000:1.0:1789302452.064506:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302452.064512:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302452.064522:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789302452.064524:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302452.064850:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 53 00000100:00100000:2.0:1789302452.064861:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2398:x1876219101571968:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302452.065029:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2398:x1876219101571968:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 168us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302452.065038:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 53 00010000:00010000:1.0:1789302452.761305:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302452.822286:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121584128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302452.822370:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302452.822482:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121584128 00000100:00100000:3.0:1789302452.822491:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121584128 00000100:00100000:3.0:1789302452.822562:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789302452.822572:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121584128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789302452.822599:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789302452.824695:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121584128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2113us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302452.824709:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789302452.824778:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302452.824869:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121584128:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1789302452.828218:0:19430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c39c9e8-9b50-402e-a4e7-1190d400118d 00010000:00010000:3.0:1789302453.780293:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302453.844325:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302453.844347:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121584256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302453.844416:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302453.844466:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121584256 00000100:00100000:2.0:1789302453.844481:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121584256 00000100:00100000:2.0:1789302453.844541:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302453.844550:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121584256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302453.844570:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789302453.844627:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121584256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302453.844634:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789302453.844657:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302453.844693:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121584256:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789302454.117908:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789302454.357869:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302454.357893:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121584384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789302454.357959:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302454.358195:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121584384 00000100:00100000:2.0:1789302454.358203:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121584384 00000100:00100000:2.0:1789302454.358252:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789302454.358262:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121584384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302454.358296:0:17116:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789302454.358343:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121584384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302454.358349:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789302454.358442:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121584384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789302454.358905:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302454.358915:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121584512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789302454.358949:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302454.359090:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121584512 00000100:00100000:1.0:1789302454.359096:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121584512 00000100:00100000:1.0:1789302454.359169:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789302454.359176:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121584512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789302454.359198:0:17850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789302454.359239:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121584512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302454.359246:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789302454.359279:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121584512:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1789302454.656007:0:20133:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd51f8500 20000000:00000080:1.0:1789302454.656024:0:20133:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cc4869dc400 uarg=0000000000000000 20000000:01000000:1.0:1789302454.658518:0:20133:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789302454.658524:0:20133:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789302454.658529:0:20133:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789302454.659180:0:20134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789302454.659434:0:20133:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789302454.674637:0:20133:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789302454.674668:0:20133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.674686:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd39a5f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a5ed expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.674725:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48311d200/0x1ff82925bd39a602 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a5fb expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.674732:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd39a641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a63a expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.674738:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a79f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a798 expref: 23 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.674747:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48166e000/0x1ff82925bd39a8ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e41 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.674754:0:20133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cc48166f600/0x1ff82925bd39a92e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5eb1 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.674762:0:20133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.674803:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48166f600/0x1ff82925bd39a92e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5eb1 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.674818:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc48166f600/0x1ff82925bd39a92e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5eb1 expref: 12 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302454.674833:0:20133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384297480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121584640:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302454.674939:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48166e000/0x1ff82925bd39a8ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e41 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.674948:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc48166e000/0x1ff82925bd39a8ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e41 expref: 12 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302454.674966:0:20133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121584768:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302454.674998:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a79f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a798 expref: 23 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.675007:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a79f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a798 expref: 23 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302454.675016:0:20133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384297b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121584896:0@lo:104: 00000100:00100000:2.0:1789302454.675067:0:20133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302454.675142:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd39a641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a63a expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.675151:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd39a641 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a63a expref: 23 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302454.675159:0:20133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121585024:0@lo:104: 00000100:00100000:2.0:1789302454.675180:0:20133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302454.675210:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121584896 00000100:00100000:2.0:1789302454.675217:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121584896 00000100:00100000:2.0:1789302454.675253:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121585024 00000100:00100000:2.0:1789302454.675257:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121585024 00000100:00100000:2.0:1789302454.675444:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789302454.675457:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+4:20133:x1876219121584896:12345-0@lo:104: 00010000:00010000:2.0:1789302454.675470:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.675513:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789302454.675520:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+4:20133:x1876219121584896:12345-0@lo:104: Request processed in 65us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302454.675536:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789302454.675554:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789302454.675560:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384294e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:20133:x1876219121585024:12345-0@lo:104: 00010000:00010000:2.0:1789302454.675568:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.675600:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789302454.675606:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384294e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:20133:x1876219121585024:12345-0@lo:104: Request processed in 46us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302454.675611:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789302454.675642:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc48311d200/0x1ff82925bd39a602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a5fb expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.675650:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc48311d200/0x1ff82925bd39a602 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a5fb expref: 23 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302454.675657:0:20133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121585152:0@lo:104: 00000100:00100000:2.0:1789302454.675679:0:20133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302454.675698:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121585152 00000100:00100000:2.0:1789302454.675714:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121585152 00000100:00100000:2.0:1789302454.675733:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789302454.675739:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384295180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:20133:x1876219121585152:12345-0@lo:104: 00010000:00010000:2.0:1789302454.675747:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.675774:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789302454.675779:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384295180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:20133:x1876219121585152:12345-0@lo:104: Request processed in 41us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302454.675794:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789302454.675824:0:20133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd39a5f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1ff82925bd39a5ed expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.675833:0:20133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd39a5f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1ff82925bd39a5ed expref: 23 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302454.675841:0:20133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121585280:0@lo:104: 00000100:00100000:2.0:1789302454.675864:0:20133:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302454.675883:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121585280 00000100:00100000:2.0:1789302454.675887:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121585280 00000100:00100000:2.0:1789302454.675904:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789302454.675910:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:20133:x1876219121585280:12345-0@lo:104: 00010000:00010000:2.0:1789302454.675917:0:17093:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.675942:0:17093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789302454.675947:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c46098ed-e570-4ba8-9393-0223b90f3f6e+3:20133:x1876219121585280:12345-0@lo:104: Request processed in 38us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302454.675953:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789302454.675971:0:20133:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302454.675993:0:20133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384297b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121584896:0@lo:104: 00000100:00100000:2.0:1789302454.676001:0:20133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121585024:0@lo:104: 00000100:00100000:2.0:1789302454.676008:0:20133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121585152:0@lo:104: 00000100:00100000:2.0:1789302454.676014:0:20133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121585280:0@lo:104: 00010000:00010000:1.0:1789302454.676146:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789302454.676166:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676173:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982400 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302454.676177:0:17099:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676185:0:17099:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302454.676193:0:17099:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302454.676199:0:17099:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789302454.676227:0:17099:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676234:0:17099:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302454.676256:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676263:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982400/0x1ff82925bd39a798 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a79f expref: -99 pid: 19429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676286:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789302454.676289:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676295:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982800 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302454.676298:0:17099:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676316:0:17099:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302454.676322:0:17099:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302454.676327:0:17099:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789302454.676342:0:17099:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676347:0:17099:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302454.676354:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676361:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc4aa982800/0x1ff82925bd39a63a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a641 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676370:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302454.676373:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676378:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aba00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302454.676381:0:17099:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676388:0:17099:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302454.676394:0:17099:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302454.676406:0:17099:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789302454.676421:0:17099:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676427:0:17099:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302454.676443:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676451:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc3839aba00/0x1ff82925bd39a5fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a602 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676460:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302454.676463:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676469:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48311ca00 already unused, calling callback (ffffffffc13cfc20) 10000000:00010000:1.0:1789302454.676472:0:17099:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676478:0:17099:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302454.676485:0:17099:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302454.676490:0:17099:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789302454.676502:0:17099:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676507:0:17099:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302454.676521:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676527:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.109@tcp lock: ffff8cc48311ca00/0x1ff82925bd39a5ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1ff82925bd39a5f4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676540:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302454.676542:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302454.676544:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302454.676570:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121585408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302454.676605:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302454.676637:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302454.676642:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121585536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302454.676663:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302454.676689:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121585664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302454.676710:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302454.676726:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302454.676731:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121585792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302454.676749:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302454.676774:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121585408 00000100:00100000:1.0:1789302454.676778:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121585408 00010000:00010000:1.0:1789302454.676796:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a79f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a798 expref: 24 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302454.676811:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121585536 00000100:00100000:1.0:1789302454.676813:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121585536 00010000:00010000:1.0:1789302454.676825:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd39a641 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a63a expref: 25 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302454.676835:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121585664 00000100:00100000:1.0:1789302454.676843:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121585664 00010000:00010000:1.0:1789302454.676857:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48311d200/0x1ff82925bd39a602 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a5fb expref: 26 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302454.676868:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121585792 00000100:00100000:1.0:1789302454.676870:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121585792 00010000:00010000:1.0:1789302454.676880:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd39a5f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a5ed expref: 27 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302454.676910:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302454.676919:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c46098ed-e570-4ba8-9393-0223b90f3f6e+27:3645:x1876219121585408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302454.676929:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302454.676934:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a79f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a798 expref: 27 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676943:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a79f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a798 expref: 27 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676956:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a79f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a798 expref: 27 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.676968:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302454.676998:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c46098ed-e570-4ba8-9393-0223b90f3f6e+26:3645:x1876219121585408:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302454.677004:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302454.677021:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302454.677038:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c46098ed-e570-4ba8-9393-0223b90f3f6e+25:3645:x1876219121585536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302454.677058:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302454.677063:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd39a641 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a63a expref: 25 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.677079:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd39a641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a63a expref: 25 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.677088:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5349400/0x1ff82925bd39a641 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a63a expref: 25 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.677096:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302454.677149:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:3645:x1876219121585536:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302454.677155:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302454.677170:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302454.677176:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:3647:x1876219121585664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302454.677183:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302454.677187:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48311d200/0x1ff82925bd39a602 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a5fb expref: 23 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.677195:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48311d200/0x1ff82925bd39a602 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a5fb expref: 23 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.677204:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48311d200/0x1ff82925bd39a602 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a5fb expref: 23 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.677214:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302454.677240:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:3647:x1876219121585664:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302454.677246:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302454.677261:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302454.677267:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:3647:x1876219121585792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302454.677280:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302454.677285:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd39a5f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1ff82925bd39a5ed expref: 21 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.677293:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd39a5f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1ff82925bd39a5ed expref: 21 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.677302:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4aa982000/0x1ff82925bd39a5f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1ff82925bd39a5ed expref: 21 pid: 17105 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.677311:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302454.677334:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:3647:x1876219121585792:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302454.677340:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302454.677374:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121585792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302454.677381:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c46098ed-e570-4ba8-9393-0223b90f3f6e:3647:1876219121585664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302454.677404:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121585536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302454.677411:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c46098ed-e570-4ba8-9393-0223b90f3f6e:3645:1876219121585408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302454.677896:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302454.681193:0:20133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384297480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121584640:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302454.681208:0:20133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20133:1876219121584768:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302454.681262:0:20133:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302454.682289:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302454.682578:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101572480 00000100:00100000:2.0:1789302454.682587:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101572480 00010000:00010000:2.0:1789302454.682625:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48166f600/0x1ff82925bd39a92e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5eb1 expref: 13 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302454.682662:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:2.0:1789302454.682671:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbe2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6def970d-8bc0-4857-87d9-88981813c2ca+13:2398:x1876219101572480:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302454.682686:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302454.682692:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48166f600/0x1ff82925bd39a92e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5eb1 expref: 13 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.682702:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48166f600/0x1ff82925bd39a92e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5eb1 expref: 13 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.682732:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166f600/0x1ff82925bd39a92e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5eb1 expref: 13 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.682748:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302454.682799:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbe2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6def970d-8bc0-4857-87d9-88981813c2ca+12:2398:x1876219101572480:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 129us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302454.682807:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:1.0:1789302454.686756:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302454.686824:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101572608 00000100:00100000:2.0:1789302454.686833:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101572608 00010000:00010000:2.0:1789302454.686870:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cc48166e000/0x1ff82925bd39a8ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e41 expref: 12 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302454.686912:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00100000:2.0:1789302454.686933:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a7f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6def970d-8bc0-4857-87d9-88981813c2ca+12:2398:x1876219101572608:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302454.686949:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302454.686955:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cc48166e000/0x1ff82925bd39a8ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e41 expref: 12 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.686968:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cc48166e000/0x1ff82925bd39a8ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e41 expref: 12 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.686986:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc48166e000/0x1ff82925bd39a8ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e41 expref: 12 pid: 17104 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.687003:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.687011:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.687038:0:17095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.687046:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.687053:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.687060:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.687066:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349c00 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302454.687070:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.687085:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.687108:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302454.687143:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302454.687197:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a7f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6def970d-8bc0-4857-87d9-88981813c2ca+11:2398:x1876219101572608:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 265us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302454.687205:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 14 00010000:00010000:3.0:1789302454.687281:0:20133:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302454.687291:0:20133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302454.687297:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cc4b5349c00/0x1ff82925bd39a95f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302454.805940:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789302455.764183:0:17107:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789302455.764190:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc3829c5800 from 13 10000000:01000000:2.0:1789302455.764208:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789302455.764260:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd39a966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302455.764271:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd39a966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302455.764283:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd39a966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302455.764307:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121585920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302455.764391:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302455.764452:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48672c900 going to sleep for 11 seconds 00000100:00100000:0.0:1789302455.764478:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121585920 00000100:00100000:0.0:1789302455.764488:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121585920 00000100:00100000:0.0:1789302455.764543:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789302455.764552:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+20:17107:x1876219121585920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302455.764565:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302455.764578:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538ec00/0x1ff82925bd39a96d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a966 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302455.764601:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538ec00/0x1ff82925bd39a96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a966 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302455.764612:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538ec00/0x1ff82925bd39a96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a966 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302455.764621:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538ec00, rc 0) 00000100:00100000:0.0:1789302455.764673:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:17107:x1876219121585920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.764679:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789302455.764858:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121585920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302455.764874:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd39a966 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a96d expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302455.764895:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd39a966 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a96d expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302455.765042:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302455.765081:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302455.765099:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48672c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302455.765184:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121586048 00000100:00100000:1.0:1789302455.765189:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121586048 00000100:00100000:1.0:1789302455.765215:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789302455.765222:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:17107:x1876219121586048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302455.765318:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:17107:x1876219121586048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.765330:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789302455.765501:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302455.765529:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302455.765568:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302455.765626:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48672c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302455.768588:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121586176 00000100:00100000:1.0:1789302455.768603:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121586176 00000100:00100000:1.0:1789302455.768920:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789302455.768940:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:17107:x1876219121586176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302455.771895:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:17107:x1876219121586176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2960us (6319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.771907:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789302455.772089:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789302455.776576:0:20172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789302455.781378:0:17107:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789302455.781431:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302455.781442:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd39a966 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a96d expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302455.781454:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5349e00/0x1ff82925bd39a966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a96d expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302455.781464:0:17107:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789302455.781466:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc485d4e000 from 13 10000000:01000000:2.0:1789302455.781469:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789302455.781502:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd39a974 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302455.781515:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd39a974 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302455.781536:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd39a974 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302455.781561:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302455.781866:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302455.781918:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc484ed2300 going to sleep for 11 seconds 00000100:00100000:3.0:1789302455.782038:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121586304 00000100:00100000:3.0:1789302455.782046:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121586304 00000100:00100000:3.0:1789302455.782108:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789302455.782188:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+21:17107:x1876219121586304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302455.782202:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302455.782217:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a97b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a974 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302455.782243:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a97b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a974 expref: 22 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302455.782267:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4aa982e00/0x1ff82925bd39a97b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a974 expref: 22 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302455.782275:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982e00, rc 0) 00000100:00100000:3.0:1789302455.782332:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:17107:x1876219121586304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302455.782340:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789302455.782367:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302455.782383:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd39a974 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a97b expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302455.782393:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd39a974 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a97b expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302455.782454:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302455.782485:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302455.782503:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121586432 00000100:00100000:2.0:1789302455.782509:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121586432 00000100:00100000:1.0:1789302455.782509:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302455.782541:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789302455.782554:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:17107:x1876219121586432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302455.782664:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:17107:x1876219121586432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.786871:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302455.786941:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302455.787012:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302455.787061:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b5326840 going to sleep for 11 seconds 00000100:00100000:0.0:1789302455.787093:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121586560 00000100:00100000:0.0:1789302455.787099:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121586560 00000100:00100000:0.0:1789302455.787154:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789302455.787163:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121586560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302455.787279:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121586560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.787286:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789302455.787333:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302455.787825:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000040:00080000:2.0:1789302455.789533:0:20175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789302455.793811:0:17107:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789302455.793849:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302455.793861:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd39a974 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a97b expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302455.793874:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b5348c00/0x1ff82925bd39a974 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a97b expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302455.793885:0:17107:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302455.793894:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc4b5eab000 from 13 10000000:01000000:1.0:1789302455.793897:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302455.794797:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166ee00/0x1ff82925bd39a982 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302455.794808:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc48166ee00/0x1ff82925bd39a982 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302455.794821:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc48166ee00/0x1ff82925bd39a982 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302455.794845:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302455.794910:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.795310:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302455.795353:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121586688 00000100:00100000:2.0:1789302455.795361:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121586688 00000100:00100000:2.0:1789302455.795479:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789302455.795490:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+22:17107:x1876219121586688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302455.795502:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302455.795517:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b5348a00/0x1ff82925bd39a989 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a982 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302455.795543:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b5348a00/0x1ff82925bd39a989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a982 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302455.795554:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b5348a00/0x1ff82925bd39a989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a982 expref: 23 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302455.795572:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348a00, rc 0) 00000100:00100000:2.0:1789302455.795654:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121586688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302455.795661:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789302455.795810:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302455.795825:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc48166ee00/0x1ff82925bd39a982 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a989 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302455.795835:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc48166ee00/0x1ff82925bd39a982 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a989 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302455.795902:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302455.797862:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.797928:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121586816 00000100:00100000:1.0:1789302455.797947:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121586816 00000100:00100000:1.0:1789302455.797991:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789302455.798000:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121586816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302455.798167:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121586816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.798182:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789302455.798601:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4adfdd480 going to sleep for 11 seconds 00000100:00100000:0.0:1789302455.798627:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302455.798674:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302455.798790:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302455.798817:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b5326c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302455.798868:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121586944 00000100:00100000:1.0:1789302455.798874:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121586944 00000100:00100000:1.0:1789302455.798949:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789302455.798957:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121586944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302455.799077:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121586944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.799085:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789302455.799162:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121586944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789302455.801276:0:20179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789302455.801349:0:17107:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789302455.801372:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302455.801779:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc48166ee00/0x1ff82925bd39a982 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a989 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302455.801793:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc48166ee00/0x1ff82925bd39a982 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a989 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302455.801803:0:17107:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789302455.801806:0:17107:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cc38422d000 from 13 10000000:01000000:0.0:1789302455.801809:0:17107:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302455.801845:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd39a990 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302455.801854:0:17107:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd39a990 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302455.801872:0:17107:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd39a990 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302455.801896:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485d53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121587072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302455.802624:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302455.802658:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b5326f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302455.802890:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121587072 00000100:00100000:1.0:1789302455.802897:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121587072 00000100:00100000:1.0:1789302455.802963:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789302455.802972:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+23:17107:x1876219121587072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302455.804816:0:17102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302455.805230:0:17102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538f600/0x1ff82925bd39a997 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1ff82925bd39a990 expref: -99 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302455.805265:0:17102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538f600/0x1ff82925bd39a997 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1ff82925bd39a990 expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302455.805278:0:17102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538f600/0x1ff82925bd39a997 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1ff82925bd39a990 expref: 24 pid: 17102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302455.805287:0:17102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538f600, rc 0) 00000100:00100000:0.0:1789302455.805362:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:17107:x1876219121587072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2389us (2738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.805371:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789302455.805482:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485d53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121587072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302455.805500:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd39a990 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a997 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302455.805510:0:17107:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd39a990 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1ff82925bd39a997 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302455.805586:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121587200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302455.805621:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.805651:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a7f24900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302455.805668:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121587200 00000100:00100000:1.0:1789302455.805673:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121587200 00000100:00100000:1.0:1789302455.805720:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789302455.805735:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4ade98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+25:17107:x1876219121587200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302455.805835:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4ade98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+25:17107:x1876219121587200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.805842:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789302455.805873:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121587200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302455.805898:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121587328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302455.805933:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.805962:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4a0ab0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302455.805985:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121587328 00000100:00100000:3.0:1789302455.805989:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121587328 00000100:00100000:3.0:1789302455.806009:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789302455.806015:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc49921ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+25:17107:x1876219121587328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302455.806130:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc49921ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c46098ed-e570-4ba8-9393-0223b90f3f6e+25:17107:x1876219121587328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302455.806137:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789302455.806221:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c46098ed-e570-4ba8-9393-0223b90f3f6e:17107:1876219121587328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789302455.808888:0:20180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789302455.810466:0:17107:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789302455.810497:0:17107:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302455.810508:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd39a990 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a997 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302455.810521:0:17107:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.109@tcp lock: ffff8cc4b538e600/0x1ff82925bd39a990 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1ff82925bd39a997 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302455.830617:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302455.897067:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121587584:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.897155:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.897185:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121588096:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.897208:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.897225:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121588608:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.897246:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.897273:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789302455.897279:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121587456:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.897302:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.897320:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121587968:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.897339:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.897355:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121588480:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.897373:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.897407:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121587712:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.897448:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.897465:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121588224:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.897485:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.897503:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121588736:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.897522:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.897540:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789302455.897545:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121587840:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.897565:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.897590:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4a7f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121588352:0@lo:400:kworker.0 00000100:00100000:0.0:1789302455.897603:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121588608 00000100:00100000:1.0:1789302455.897607:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302455.897610:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121588608 00000100:00100000:1.0:1789302455.897616:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121588864:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.897632:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.897654:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121587584 00000100:00100000:0.0:1789302455.897657:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121588480 00000100:00100000:1.0:1789302455.897658:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121587584 00000100:00100000:0.0:1789302455.897660:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121588480 00000100:00100000:0.0:1789302455.897671:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121588736 00000100:00100000:0.0:1789302455.897673:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121588736 00000100:00100000:1.0:1789302455.897678:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121588096 00000100:00100000:1.0:1789302455.897681:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121588096 00000100:00100000:0.0:1789302455.897683:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121587840 00000100:00100000:0.0:1789302455.897685:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121587840 00000100:00100000:1.0:1789302455.897691:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121587712 00000100:00100000:1.0:1789302455.897693:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121587712 00000100:00100000:0.0:1789302455.897709:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121588352 00000100:00100000:0.0:1789302455.897712:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121588352 00000100:00100000:1.0:1789302455.897714:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121588224 00000100:00100000:1.0:1789302455.897716:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121588224 00000100:00100000:0.0:1789302455.897721:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121588864 00000100:00100000:0.0:1789302455.897723:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121588864 00000100:00100000:1.0:1789302455.897731:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789302455.897734:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789302455.897738:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121587584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302455.897739:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121588608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302455.897786:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876219121588608:12345-0@lo:400:kworker.0 Request processed in 46us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.897793:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789302455.897809:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789302455.897814:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121588480:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789302455.898131:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302455.898136:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302455.898138:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302455.898140:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789302455.900299:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121587584:12345-0@lo:400:kworker.0 Request processed in 2551us (3134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.900313:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789302455.900345:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789302455.900359:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121588096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.900443:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121588096:12345-0@lo:400:kworker.0 Request processed in 90us (3234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.900449:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789302455.900462:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789302455.900470:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc486b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121587712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.900509:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc486b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121587712:12345-0@lo:400:kworker.0 Request processed in 41us (3061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.900515:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789302455.900621:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789302455.900629:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121588224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.900655:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121588224:12345-0@lo:400:kworker.0 Request processed in 28us (3169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.900660:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789302455.900694:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789302455.900886:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121588480:12345-0@lo:400:kworker.0 Request processed in 3070us (3510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.900894:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789302455.900913:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789302455.900920:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121587840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302455.900952:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876219121587840:12345-0@lo:400:kworker.0 Request processed in 34us (3386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.900957:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789302455.900969:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789302455.900974:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121588352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302455.901209:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876219121588352:12345-0@lo:400:kworker.0 Request processed in 234us (3599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.901215:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789302455.901228:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789302455.901235:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121588864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302455.901259:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876219121588864:12345-0@lo:400:kworker.0 Request processed in 26us (3627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.901264:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789302455.901455:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc383a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121588992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302455.901491:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302455.901534:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121588992 00000100:00100000:0.0:1789302455.901541:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121588992 00000100:00100000:0.0:1789302455.901574:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789302455.901580:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121588992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302455.901601:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789302455.901637:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121588992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.901642:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789302455.901685:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc383a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121588992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302455.902715:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121587456 00000100:00100000:0.0:1789302455.902724:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121587456 00000100:00100000:0.0:1789302455.902760:0:17850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121587968 00000100:00100000:0.0:1789302455.902763:0:17850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121587968 00000100:00100000:0.0:1789302455.902777:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789302455.902783:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121587456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302455.902834:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121587456:12345-0@lo:400:kworker.0 Request processed in 52us (5531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.902852:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789302455.902865:0:17850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789302455.902870:0:17850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121587968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302455.902896:0:17850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121587968:12345-0@lo:400:kworker.0 Request processed in 26us (5556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.902901:0:17850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789302455.903354:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876219121587840:0@lo:400:kworker.0 00000100:00100000:3.0:1789302455.903368:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876219121588352:0@lo:400:kworker.0 00010000:00080000:3.0:1789302455.903393:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eed500 x1876219121588864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302455.903405:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876219121588864:0@lo:400:kworker.0 00000100:00100000:3.0:1789302455.903423:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121587712:0@lo:400:kworker.0 00000100:00100000:3.0:1789302455.903434:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121588224:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.903575:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121588736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.903630:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876219121588736:12345-0@lo:400:kworker.0 Request processed in 61us (6106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.903638:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789302455.903681:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121587456:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.903691:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121587968:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.903770:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121588480:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.903783:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121587584:0@lo:400:kworker.0 00000100:00100000:1.0:1789302455.903792:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4a7f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121588096:0@lo:400:kworker.0 00010000:00080000:1.0:1789302455.903816:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc4b7eef800 x1876219121588608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302455.903826:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876219121588608:0@lo:400:kworker.0 00000100:00100000:3.0:1789302455.903896:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876219121588736:0@lo:400:kworker.0 00000100:00100000:0.0:1789302455.905567:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302455.905588:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121589120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789302455.905651:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302455.905692:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121589120 00000100:00100000:0.0:1789302455.905759:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121589120 00000100:00100000:0.0:1789302455.905803:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789302455.905812:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121589120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789302455.905833:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789302455.905876:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121589120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.905883:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789302455.905924:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121589120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302456.659745:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302456.659896:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101572736 00000100:00100000:0.0:1789302456.659906:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101572736 00000100:00100000:0.0:1789302456.659970:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 159 00000100:00100000:0.0:1789302456.659982:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc49921b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+11:14900:x1876219101572736:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302456.659998:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302456.660024:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc4b538f000/0x1ff82925bd39a99e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ee9 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302456.660076:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc4b538f000/0x1ff82925bd39a99e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ee9 expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302456.660090:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc4b538f000/0x1ff82925bd39a99e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ee9 expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302456.660099:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538f000, rc 0) 00000100:00100000:0.0:1789302456.660195:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc49921b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+12:14900:x1876219101572736:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 Request processed in 214us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302456.660202:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 159 00000100:00100000:0.0:1789302456.664717:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302456.664828:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101572864 00000100:00100000:2.0:1789302456.664837:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101572864 00000100:00100000:2.0:1789302456.664894:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 160 00000100:00100000:2.0:1789302456.664945:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc49921b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+12:14900:x1876219101572864:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302456.665283:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc49921b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+12:14900:x1876219101572864:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 Request processed in 378us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302456.665292:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 160 00000100:00100000:0.0:1789302456.688162:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302456.688223:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101572992 00000100:00100000:2.0:1789302456.688232:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101572992 00000100:00100000:2.0:1789302456.688969:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 161 00000100:00100000:2.0:1789302456.688982:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc499219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+12:14900:x1876219101572992:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302456.689163:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc499219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+12:14900:x1876219101572992:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 Request processed in 184us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302456.689171:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 161 00000100:00100000:3.0:1789302456.706668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302456.706914:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101573120 00000100:00100000:1.0:1789302456.706924:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101573120 00000100:00100000:1.0:1789302456.706979:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 162 00000100:00100000:1.0:1789302456.706989:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc499219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+12:14900:x1876219101573120:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302456.707004:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302456.707029:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a9a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ef0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302456.707057:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a9a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ef0 expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302456.707068:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cc48166f800/0x1ff82925bd39a9a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ef0 expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302456.707077:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f800, rc 0) 00000100:00100000:1.0:1789302456.707151:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc499219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+13:14900:x1876219101573120:12345-192.168.203.9@tcp:101:ll_cfg_requeue.0 Request processed in 163us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302456.707159:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 162 00000100:00100000:2.0:1789302456.715061:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302456.715185:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101573248 00000100:00100000:3.0:1789302456.715195:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101573248 00000100:00100000:3.0:1789302456.715249:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 163 00000100:00100000:3.0:1789302456.715260:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc483dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+13:14900:x1876219101573248:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302456.715405:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc483dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6def970d-8bc0-4857-87d9-88981813c2ca+13:14900:x1876219101573248:12345-192.168.203.9@tcp:501:ll_cfg_requeue.0 Request processed in 147us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302456.715412:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 163 00000100:00100000:2.0:1789302456.720236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302456.720268:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101573376 00000100:00100000:2.0:1789302456.720276:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101573376 00000100:00100000:2.0:1789302456.720321:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 164 00000100:00100000:2.0:1789302456.720330:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc483dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+13:14900:x1876219101573376:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302456.720471:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc483dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+13:14900:x1876219101573376:12345-192.168.203.9@tcp:503:ll_cfg_requeue.0 Request processed in 141us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302456.720479:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 164 00010000:00010000:1.0:1789302456.853632:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302457.174032:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302457.174071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302457.174136:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302457.174162:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302457.174177:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101573632 00000100:00100000:0.0:1789302457.174185:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302457.174186:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101573632 00000100:00100000:0.0:1789302457.174205:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302457.174219:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302457.174240:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302457.174242:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101574144 00000100:00100000:2.0:1789302457.174245:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101574144 00000100:00100000:1.0:1789302457.174250:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101573888 00000100:00100000:1.0:1789302457.174257:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101573888 00000100:00100000:2.0:1789302457.174262:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101573760 00000100:00100000:2.0:1789302457.174267:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101573760 00000100:00100000:0.0:1789302457.174279:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302457.174296:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101574272 00000100:00100000:2.0:1789302457.174299:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101574272 00000100:00100000:2.0:1789302457.174315:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:2.0:1789302457.174325:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+6:2396:x1876219101573632:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302457.174552:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:2.0:1789302457.174559:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+6:2396:x1876219101573632:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 235us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302457.174562:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2396:x1876219101574144:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302457.174567:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:2.0:1789302457.174583:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 62 00000100:00100000:3.0:1789302457.174589:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2396:x1876219101574144:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 31us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302457.174589:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2396:x1876219101573760:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302457.174595:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:3.0:1789302457.174608:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:3.0:1789302457.174614:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2396:x1876219101574272:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302457.174638:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2396:x1876219101574272:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302457.174644:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00080000:3.0:1789302457.174676:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789302457.174681:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789302457.174707:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302457.174719:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101573504 00000100:00100000:3.0:1789302457.174723:0:17104:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101573504 00000100:00100000:3.0:1789302457.174755:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 165 00000100:00100000:3.0:1789302457.174762:0:17104:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc483daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+13:2396:x1876219101573504:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302457.174789:0:17104:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc483daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6def970d-8bc0-4857-87d9-88981813c2ca+13:2396:x1876219101573504:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 28us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302457.174794:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 165 00000100:00100000:2.0:1789302457.174962:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2396:x1876219101573760:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 371us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302457.174969:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 62 00000100:00100000:1.0:1789302457.175365:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101574400 00000100:00100000:1.0:1789302457.175371:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101574400 00000100:00100000:1.0:1789302457.175397:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101574016 00000100:00100000:1.0:1789302457.175408:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101574016 00000100:00100000:1.0:1789302457.175425:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101574528 00000100:00100000:1.0:1789302457.175428:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101574528 00000100:00100000:1.0:1789302457.175444:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:1.0:1789302457.175451:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2396:x1876219101573888:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302457.175483:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2396:x1876219101573888:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 33us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302457.175490:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:1.0:1789302457.175505:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:1.0:1789302457.175512:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2396:x1876219101574400:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302457.175535:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2396:x1876219101574400:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 24us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302457.175540:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:1.0:1789302457.175552:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:1.0:1789302457.175558:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2396:x1876219101574016:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302457.175579:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2396:x1876219101574016:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302457.175585:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:1.0:1789302457.175596:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:1.0:1789302457.175602:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2396:x1876219101574528:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:1.0:1789302457.175624:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2396:x1876219101574528:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 23us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302457.175630:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00080000:1.0:1789302457.175647:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302457.175655:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789302457.878487:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302457.940389:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302457.940412:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121589248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789302457.940479:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302457.940577:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121589248 00000100:00100000:0.0:1789302457.940584:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121589248 00000100:00100000:0.0:1789302457.940658:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789302457.940667:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121589248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302457.940697:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789302457.940766:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876219121589248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302457.940773:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789302457.940883:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302457.941068:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc3843ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121589248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302458.074451:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.074589:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101574656 00000100:00100000:1.0:1789302458.074603:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101574656 00000100:00100000:1.0:1789302458.074676:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:1.0:1789302458.074687:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+6:15569:x1876219101574656:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302458.074825:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302458.074851:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a9ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5ef7 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.074913:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.074927:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.074940:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.074954:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.074961:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.074967:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075167:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166e000/0x1ff82925bd39a9c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075177:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166e000/0x1ff82925bd39a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075184:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166e000/0x1ff82925bd39a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302458.075269:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789302458.075273:0:17111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302458.075309:0:17111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166e000/0x1ff82925bd39a9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075320:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075326:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075333:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075339:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166fa00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302458.075343:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075351:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075363:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa6100) 00010000:00010000:1.0:1789302458.075372:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302458.075377:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075383:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075399:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075405:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075411:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075416:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166f600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302458.075419:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075425:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075433:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cc383963600) 00010000:00010000:1.0:1789302458.075436:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302458.075439:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075445:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075475:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a9ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ef7 expref: 8 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075499:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166e000/0x1ff82925bd39a9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ef7 expref: 7 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.075506:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cc383963300) 00010000:00010000:1.0:1789302458.075509:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302458.075511:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166e000, rc 0) 00000100:00100000:1.0:1789302458.075577:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+7:15569:x1876219101574656:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 892us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302458.075584:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:3.0:1789302458.080441:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.080528:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101574784 00000100:00100000:1.0:1789302458.080538:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101574784 00000100:00100000:1.0:1789302458.080591:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5 00000100:00100000:1.0:1789302458.080600:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9f958801-6e12-44ad-8390-fe02a2305ca5+7:15569:x1876219101574784:12345-192.168.203.9@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789302458.080678:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9f958801-6e12-44ad-8390-fe02a2305ca5+7:15569:x1876219101574784:12345-192.168.203.9@tcp:900:lhsmtool_posix.0 Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302458.080686:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5 00000100:00100000:2.0:1789302458.083829:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.083913:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101575040 00000100:00100000:3.0:1789302458.083922:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101575040 00000100:00100000:3.0:1789302458.083977:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:3.0:1789302458.083986:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+7:15569:x1876219101575040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302458.084020:0:18366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302458.084042:0:18366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a9c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5efe expref: -99 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084141:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a9cf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084156:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a9cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084167:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a9cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084230:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a9d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084255:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084262:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084366:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a9dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084376:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a9dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084383:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a9dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302458.084392:0:18366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789302458.084534:0:18366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a9cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084542:0:18366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a9cf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084549:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a9cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084555:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa983a00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302458.084559:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a9cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084567:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a9cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084589:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cc383963300) 00010000:00010000:3.0:1789302458.084592:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302458.084597:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a9cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084604:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39a9cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084617:0:18366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084623:0:18366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a9d6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084629:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084634:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302458.084637:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084642:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a9d6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084648:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cc381fa8700) 00010000:00010000:3.0:1789302458.084650:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302458.084653:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a9d6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.084658:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39a9d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.091834:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39a9c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5efe expref: 10 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.091861:0:18366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982800/0x1ff82925bd39a9dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5efe expref: 9 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.091870:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc381fa8b00) 00010000:00010000:3.0:1789302458.091873:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302458.091876:0:18366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982800, rc 0) 00000100:00100000:3.0:1789302458.091963:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+9:15569:x1876219101575040:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 7977us (8142us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789302458.091973:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:2.0:1789302458.106129:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.106402:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101575168 00000100:00100000:3.0:1789302458.106413:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101575168 00000100:00100000:3.0:1789302458.106475:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:3.0:1789302458.106485:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+9:15569:x1876219101575168:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789302458.106586:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+9:15569:x1876219101575168:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 Request processed in 102us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302458.106595:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:0.0:1789302458.116874:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302458.117038:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101575296 00000100:00100000:2.0:1789302458.117048:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101575296 00000100:00100000:2.0:1789302458.117188:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 26 00000100:00100000:2.0:1789302458.117199:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:15569:x1876219101575296:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789302458.122147:0:17110:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4831us 00000100:00100000:3.0:1789302458.142410:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:15569:x1876219101575296:12345-192.168.203.9@tcp:59:lhsmtool_posix.0 Request processed in 25205us (25536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302458.142424:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 26 00000100:00100000:2.0:1789302458.161917:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.162050:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101575424 00000100:00100000:3.0:1789302458.162060:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101575424 00000100:00100000:1.0:1789302458.162263:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 27 00000100:00100000:1.0:1789302458.162275:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+9:15575:x1876219101575424:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302458.162294:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302458.162312:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a9eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f05 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162372:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162401:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162413:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162429:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162436:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162443:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162482:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162489:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162496:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162502:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166f600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302458.162506:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162514:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162525:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa6100) 00010000:00010000:1.0:1789302458.162534:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302458.162540:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162546:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39a9f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162560:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162566:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162571:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162576:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166fa00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302458.162578:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162596:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162606:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cc383963600) 00010000:00010000:1.0:1789302458.162608:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302458.162611:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162615:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39a9f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162645:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a9eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f05 expref: 10 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162661:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa6100) 00010000:00010000:1.0:1789302458.162663:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302458.162668:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39a9eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f05 expref: 10 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.162677:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f400, rc 0) 00000100:00100000:1.0:1789302458.167474:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+9:15575:x1876219101575424:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 5191us (5555us total) trans 0 rc 301/301 00000100:00100000:1.0:1789302458.167487:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 27 00000100:00100000:0.0:1789302458.172608:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302458.174502:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101575552 00000100:00100000:2.0:1789302458.174515:0:17119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101575552 00000100:00100000:2.0:1789302458.174615:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 0 00000100:00100000:2.0:1789302458.174626:0:17119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9f958801-6e12-44ad-8390-fe02a2305ca5+9:15575:x1876219101575552:12345-192.168.203.9@tcp:700:lfs.0 00000100:00100000:2.0:1789302458.174726:0:17119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9f958801-6e12-44ad-8390-fe02a2305ca5+9:15575:x1876219101575552:12345-192.168.203.9@tcp:700:lfs.0 Request processed in 101us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302458.174733:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 0 00000100:00100000:3.0:1789302458.184226:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.184378:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101575808 00000100:00100000:1.0:1789302458.184388:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101575808 00000100:00100000:1.0:1789302458.184444:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 28 00000100:00100000:1.0:1789302458.184454:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+9:15575:x1876219101575808:12345-192.168.203.9@tcp:36:lfs.0 00010000:00010000:1.0:1789302458.184507:0:18366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302458.184532:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fc00/0x1ff82925bd39a919 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5e72 expref: 9 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.184552:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa6100) 00010000:00010000:1.0:1789302458.184558:0:18366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302458.184609:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.184622:0:18366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ee2 expref: 5 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.184631:0:18366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.184677:0:18366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ee2 expref: 5 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.184691:0:18366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ee2 expref: 5 pid: 17112 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302458.184705:0:18366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18366:1876219121589376:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302458.184784:0:18366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc48547db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302458.191627:0:18366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eef100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18366:1876219121589376:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302458.191657:0:18366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302458.196929:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789302458.197127:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.197309:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101575936 00000100:00100000:1.0:1789302458.197319:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101575936 00010000:00010000:1.0:1789302458.197364:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ee2 expref: 6 pid: 17112 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302458.197401:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00100000:1.0:1789302458.197411:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2398:x1876219101575936:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302458.197425:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302458.197432:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ee2 expref: 6 pid: 17112 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.197444:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ee2 expref: 6 pid: 17112 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.197477:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39a958 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5ee2 expref: 6 pid: 17112 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.197491:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa6100) 00010000:00010000:1.0:1789302458.197497:0:17096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.197506:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.197513:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.197547:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302458.197641:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2398:x1876219101575936:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 230us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302458.197648:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 15 00010000:00010000:3.0:1789302458.197924:0:18366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.197932:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.197955:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.197965:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.197972:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202566:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202587:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202599:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302458.202617:0:18366:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d688560 reply state 00000000030a9e01 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202629:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202637:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:3.0:1789302458.202639:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302458.202643:0:18366:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789302458.202656:0:18366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789302458.202665:0:18366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202671:0:18366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202677:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202696:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166f400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302458.202701:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202709:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202721:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc381fa6100) 00010000:00010000:3.0:1789302458.202723:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302458.202727:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202733:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa00 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302458.202753:0:18366:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d688560 reply state 00000000030a9e01 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202761:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.202767:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cc381fa8700) 00010000:00010000:3.0:1789302458.202770:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302458.202777:0:18366:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789302458.202865:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+10:15575:x1876219101575808:12345-192.168.203.9@tcp:36:lfs.0 Request processed in 18408us (18642us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789302458.202873:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 28 00000100:00100000:3.0:1789302458.266265:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.266412:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101576064 00000100:00100000:1.0:1789302458.266425:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101576064 00000100:00100000:1.0:1789302458.266501:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00100000:1.0:1789302458.266514:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+10:15583:x1876219101576064:12345-192.168.203.9@tcp:101:lctl.0 00010000:00010000:1.0:1789302458.266547:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302458.266577:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39aa15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f0c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.266663:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39aa1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.266809:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39aa1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.266824:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39aa1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302458.266879:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789302458.266883:0:17112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302458.266929:0:17112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39aa1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.266957:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39aa15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f0c expref: 12 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.266979:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f600/0x1ff82925bd39aa1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f0c expref: 11 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.266989:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383963600) 00010000:00010000:1.0:1789302458.266993:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302458.266997:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc48166f600, rc 0) 00000100:00100000:1.0:1789302458.267091:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+11:15583:x1876219101576064:12345-192.168.203.9@tcp:101:lctl.0 Request processed in 580us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302458.267100:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00100000:0.0:1789302458.299199:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.299904:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101576192 00000100:00100000:3.0:1789302458.299927:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101576192 00000100:00100000:3.0:1789302458.300013:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:3.0:1789302458.300025:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:15584:x1876219101576192:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302458.300054:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302458.300081:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39aa23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f13 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.300191:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982400/0x1ff82925bd39aa2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.300208:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982400/0x1ff82925bd39aa2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.300221:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982400/0x1ff82925bd39aa2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302458.300276:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789302458.300279:0:17110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302458.300301:0:17110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982400/0x1ff82925bd39aa2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.300328:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39aa23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f13 expref: 7 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.300349:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982400/0x1ff82925bd39aa2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f13 expref: 6 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.300376:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383963600) 00010000:00010000:3.0:1789302458.300380:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302458.300384:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa982400, rc 0) 00000100:00100000:3.0:1789302458.300480:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:15584:x1876219101576192:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 457us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302458.300489:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:0.0:1789302458.303241:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.303554:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101576320 00000100:00100000:1.0:1789302458.303567:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101576320 00000100:00100000:1.0:1789302458.303675:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:1.0:1789302458.303699:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:15584:x1876219101576320:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302458.303725:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302458.303773:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39aa31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f1a expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.303857:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.303873:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.303889:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.303902:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.303909:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.303928:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304044:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aac00/0x1ff82925bd39aa46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304053:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aac00/0x1ff82925bd39aa46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304061:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aac00/0x1ff82925bd39aa46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302458.304154:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789302458.304159:0:17112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302458.304183:0:17112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aac00/0x1ff82925bd39aa46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304206:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304213:0:17112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304220:0:17112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304227:0:17112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc48166f400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302458.304232:0:17112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304240:0:17112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304255:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383963600) 00010000:00010000:1.0:1789302458.304258:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302458.304263:0:17112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304269:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166f400/0x1ff82925bd39aa38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304284:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304290:0:17112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304296:0:17112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304306:0:17112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aba00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302458.304310:0:17112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304317:0:17112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304324:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cc381fa8700) 00010000:00010000:1.0:1789302458.304326:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302458.304329:0:17112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304335:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304368:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc48166fa00/0x1ff82925bd39aa31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f1a expref: 8 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304382:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aac00/0x1ff82925bd39aa46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f1a expref: 7 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.304405:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:1.0:1789302458.304408:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302458.304411:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aac00, rc 0) 00000100:00100000:1.0:1789302458.304495:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c39c9e8-9b50-402e-a4e7-1190d400118d+7:15584:x1876219101576320:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 810us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302458.304504:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:2.0:1789302458.308021:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302458.308167:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101576448 00000100:00100000:0.0:1789302458.308181:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101576448 00000100:00100000:0.0:1789302458.308247:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6 00000100:00100000:0.0:1789302458.308259:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:15584:x1876219101576448:12345-192.168.203.9@tcp:900:lfs.0 00000100:00100000:0.0:1789302458.308370:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:15584:x1876219101576448:12345-192.168.203.9@tcp:900:lfs.0 Request processed in 113us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302458.308378:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6 00000100:00100000:0.0:1789302458.312588:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.312754:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101576704 00000100:00100000:3.0:1789302458.312768:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101576704 00000100:00100000:3.0:1789302458.312876:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 32 00000100:00100000:3.0:1789302458.312889:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc3843ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+7:15584:x1876219101576704:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:3.0:1789302458.312926:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302458.312952:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39aa4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f21 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302458.313094:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789302458.313255:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39aa4d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f21 expref: 9 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.313271:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383963600) 00010000:00010000:3.0:1789302458.313274:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302458.313280:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa983a00/0x1ff82925bd39aa4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f21 expref: 9 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.313295:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4aa983a00, rc 0) 00000100:00100000:3.0:1789302458.313370:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc3843ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+8:15584:x1876219101576704:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 484us (797us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789302458.313398:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 32 00000100:00100000:2.0:1789302458.316851:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.317074:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101576960 00000100:00100000:3.0:1789302458.317086:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101576960 00000100:00100000:3.0:1789302458.317231:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 33 00000100:00100000:3.0:1789302458.317243:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+8:15584:x1876219101576960:12345-192.168.203.9@tcp:36:lfs.0 00010000:00010000:3.0:1789302458.317319:0:17111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302458.317354:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aac00/0x1ff82925bd39aa46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f1a expref: 8 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.317376:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:3.0:1789302458.317382:0:17111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302458.317413:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.317429:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.317441:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302458.318012:0:17111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f98967f8 reply state 000000008475c470 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.318032:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.318040:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:3.0:1789302458.318043:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789302458.318046:0:17111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789302458.318076:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789302458.318272:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+9:15584:x1876219101576960:12345-192.168.203.9@tcp:36:lfs.0 Request processed in 1029us (1434us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789302458.318282:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 33 00000040:00080000:3.0:1789302458.324830:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789302458.330516:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.330631:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101577216 00000100:00100000:1.0:1789302458.330664:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101577216 00000100:00100000:1.0:1789302458.330745:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2 00000100:00100000:1.0:1789302458.330759:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+9:15584:x1876219101577216:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:1.0:1789302458.331187:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+10:15584:x1876219101577216:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 430us (685us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789302458.331197:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2 00000100:00100000:0.0:1789302458.340498:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.340705:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101577472 00000100:00100000:1.0:1789302458.340719:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101577472 00000100:00100000:1.0:1789302458.340799:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 34 00000100:00100000:1.0:1789302458.340811:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+10:15584:x1876219101577472:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302458.340844:0:18366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302458.340870:0:18366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f28 expref: -99 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.340965:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aa69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.340983:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aa69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.340997:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aa69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.341021:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.341028:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.341035:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302458.341234:0:18366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789302458.343699:0:18366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aa69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343723:0:18366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aa69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343731:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aa69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343738:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aaa00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302458.343743:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aa69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343752:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aa69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343772:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383963600) 00010000:00010000:1.0:1789302458.343776:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302458.343783:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aa69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343790:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aa69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343809:0:18366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343816:0:18366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343844:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343849:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302458.343852:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343859:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343868:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cc381fa8700) 00010000:00010000:1.0:1789302458.343870:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302458.343874:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343880:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343949:0:18366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f28 expref: 12 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343961:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383963600) 00010000:00010000:1.0:1789302458.343964:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302458.343968:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f28 expref: 12 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.343979:0:18366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aba00, rc 0) 00000100:00100000:1.0:1789302458.344085:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+11:15584:x1876219101577472:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 3276us (3608us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789302458.344108:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 34 00000100:00100000:2.0:1789302458.357946:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.358522:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101577600 00000100:00100000:1.0:1789302458.358538:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101577600 00000100:00100000:1.0:1789302458.358832:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 35 00000100:00100000:1.0:1789302458.358846:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c39c9e8-9b50-402e-a4e7-1190d400118d+11:15584:x1876219101577600:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302458.358883:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302458.358911:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa7e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f2f expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.359050:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.359069:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.359083:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302458.359142:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789302458.359147:0:17112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302458.359173:0:17112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.359206:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aa7e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f2f expref: 13 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.359228:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f2f expref: 12 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.359259:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:1.0:1789302458.359262:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302458.359267:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839ab400, rc 0) 00000100:00100000:1.0:1789302458.359481:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c39c9e8-9b50-402e-a4e7-1190d400118d+12:15584:x1876219101577600:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 638us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302458.359490:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 35 00000100:00100000:2.0:1789302458.365394:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.365595:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101577728 00000100:00100000:3.0:1789302458.365610:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101577728 00000100:00100000:3.0:1789302458.365692:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:3.0:1789302458.365705:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+12:15584:x1876219101577728:12345-192.168.203.9@tcp:37:lfs.0 00000100:00100000:3.0:1789302458.373592:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c39c9e8-9b50-402e-a4e7-1190d400118d+12:15584:x1876219101577728:12345-192.168.203.9@tcp:37:lfs.0 Request processed in 7870us (8196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302458.373614:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:2.0:1789302458.388963:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.389098:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101577984 00000100:00100000:1.0:1789302458.389159:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101577984 00000100:00100000:1.0:1789302458.389237:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 4 00000100:00100000:1.0:1789302458.389250:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8baa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+12:15584:x1876219101577984:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:1.0:1789302458.389531:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8baa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c39c9e8-9b50-402e-a4e7-1190d400118d+13:15584:x1876219101577984:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 284us (582us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789302458.389540:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 4 00000100:00100000:2.0:1789302458.440471:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.440603:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101578112 00000100:00100000:3.0:1789302458.440617:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101578112 00000100:00100000:3.0:1789302458.440704:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 36 00000100:00100000:3.0:1789302458.440716:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+11:15590:x1876219101578112:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302458.440741:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302458.440767:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39aa8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f36 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.440848:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aa93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.440865:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aa93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.440880:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aa93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.440927:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aa9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.440935:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aa9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.440943:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aa9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.441053:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031a00/0x1ff82925bd39aaa1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.441063:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031a00/0x1ff82925bd39aaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.441071:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031a00/0x1ff82925bd39aaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302458.441160:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789302458.441165:0:17110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302458.441441:0:17110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031a00/0x1ff82925bd39aaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441457:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aa93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441465:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aa93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441473:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aa93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441487:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480030c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302458.441492:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aa93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441501:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aa93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441517:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383963600) 00010000:00010000:2.0:1789302458.441521:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302458.441527:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aa93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441534:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aa93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441554:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aa9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441561:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aa9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441567:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aa9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441572:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480030400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302458.441575:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aa9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441581:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aa9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441605:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cc381fa8700) 00010000:00010000:2.0:1789302458.441608:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302458.441615:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aa9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441622:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aa9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441654:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39aa8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f36 expref: 13 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441670:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031a00/0x1ff82925bd39aaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f36 expref: 12 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302458.441677:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:2.0:1789302458.441679:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789302458.441682:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc480031a00, rc 0) 00000100:00100000:2.0:1789302458.441808:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+12:15590:x1876219101578112:12345-192.168.203.9@tcp:101:bash.0 Request processed in 1094us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302458.441817:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 36 00000100:00100000:0.0:1789302458.446836:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.447087:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101578240 00000100:00100000:1.0:1789302458.447102:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101578240 00000100:00100000:1.0:1789302458.447243:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:1.0:1789302458.447255:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9f958801-6e12-44ad-8390-fe02a2305ca5+5:15590:x1876219101578240:12345-192.168.203.9@tcp:900:bash.0 00000100:00100000:1.0:1789302458.447357:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9f958801-6e12-44ad-8390-fe02a2305ca5+5:15590:x1876219101578240:12345-192.168.203.9@tcp:900:bash.0 Request processed in 104us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302458.447365:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:0.0:1789302458.451887:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.453626:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101578496 00000100:00100000:3.0:1789302458.453640:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101578496 00000100:00100000:3.0:1789302458.453723:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 37 00000100:00100000:3.0:1789302458.453736:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+12:15590:x1876219101578496:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302458.453762:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302458.453788:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aaa8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f3d expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.453932:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.453967:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f2f expref: 12 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.453977:0:17111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.454028:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f2f expref: 12 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.454044:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f2f expref: 12 pid: 17112 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302458.454060:0:17111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17111:1876219121589504:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302458.454194:0:17111:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302458.457863:0:17111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17111:1876219121589504:192.168.203.9@tcp:104: 00010000:00010000:3.0:1789302458.457903:0:17111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302458.458238:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.458626:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101578624 00000100:00100000:1.0:1789302458.458635:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101578624 00010000:00010000:1.0:1789302458.458699:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f2f expref: 13 pid: 17112 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302458.458773:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 16 00000100:00100000:1.0:1789302458.458784:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c39c9e8-9b50-402e-a4e7-1190d400118d+13:2398:x1876219101578624:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302458.458805:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302458.458813:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f2f expref: 13 pid: 17112 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.458826:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f2f expref: 13 pid: 17112 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.458854:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aa85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f2f expref: 13 pid: 17112 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.458873:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:1.0:1789302458.458879:0:17097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.458892:0:17097:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.458901:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.458940:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302458.459025:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c39c9e8-9b50-402e-a4e7-1190d400118d+12:2398:x1876219101578624:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 241us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302458.459032:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 16 00010000:00010000:3.0:1789302458.460091:0:17111:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460106:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460171:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460184:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460209:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460783:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39aabd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460796:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39aabd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460804:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39aabd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302458.460817:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789302458.460847:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460855:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460863:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460870:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480031400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302458.460875:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460883:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460896:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:3.0:1789302458.460900:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302458.460913:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460920:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39aaaf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302458.460937:0:17111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099b903c4 reply state 000000009435d7d1 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460949:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.460956:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cc381fa8100) 00010000:00010000:3.0:1789302458.460958:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302458.460961:0:17111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789302458.461019:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aaa8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f3d expref: 15 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.461039:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39aabd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f3d expref: 14 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.461046:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:3.0:1789302458.461049:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789302458.461051:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc480031c00, rc 0) 00000100:00100000:3.0:1789302458.461155:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+15:15590:x1876219101578496:12345-192.168.203.9@tcp:101:bash.0 Request processed in 7421us (9284us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789302458.461165:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 37 00000100:00100000:2.0:1789302458.476518:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.476768:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101578752 00000100:00100000:3.0:1789302458.476782:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101578752 00000100:00100000:3.0:1789302458.476858:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 38 00000100:00100000:3.0:1789302458.476870:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+15:15590:x1876219101578752:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302458.476916:0:18366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302458.476945:0:18366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39aacb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f44 expref: -99 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.477041:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aad2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.477059:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aad2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.477073:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aad2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302458.477161:0:18366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789302458.477168:0:18366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789302458.477274:0:18366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aad2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302458.477288:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aad2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302458.477318:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39aacb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f44 expref: 17 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302458.477356:0:18366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aad2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f44 expref: 16 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302458.477364:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:0.0:1789302458.477367:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302458.477372:0:18366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc480030400, rc 0) 00000100:00100000:0.0:1789302458.477463:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+16:15590:x1876219101578752:12345-192.168.203.9@tcp:101:bash.0 Request processed in 596us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302458.477472:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 38 00000100:00100000:1.0:1789302458.483276:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302458.483398:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101579008 00000100:00100000:0.0:1789302458.483411:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101579008 00000100:00100000:0.0:1789302458.483485:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 5 00000100:00100000:0.0:1789302458.483497:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+16:15590:x1876219101579008:12345-192.168.203.9@tcp:35:bash.0 00000100:00100000:0.0:1789302458.483946:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+17:15590:x1876219101579008:12345-192.168.203.9@tcp:35:bash.0 Request processed in 449us (683us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789302458.483955:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 5 00000100:00100000:2.0:1789302458.563805:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.563942:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101579264 00000100:00100000:1.0:1789302458.563957:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101579264 00000100:00100000:1.0:1789302458.564041:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 39 00000100:00100000:1.0:1789302458.564054:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+17:15600:x1876219101579264:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302458.564088:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302458.564159:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aad9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f4b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302458.564291:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789302458.564424:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aad9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f4b expref: 19 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.564442:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383963600) 00010000:00010000:1.0:1789302458.564446:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302458.564452:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39aad9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f4b expref: 19 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302458.564469:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839ab400, rc 0) 00000100:00100000:1.0:1789302458.564598:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+18:15600:x1876219101579264:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 546us (810us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1789302458.564607:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 39 00000100:00100000:2.0:1789302458.570437:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302458.573106:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101579520 00000100:00100000:0.0:1789302458.573143:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101579520 00000100:00100000:0.0:1789302458.573239:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 6 00000100:00100000:0.0:1789302458.573252:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+18:15600:x1876219101579520:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:0.0:1789302458.573560:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+19:15600:x1876219101579520:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 311us (3138us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789302458.573569:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 6 00000100:00100000:2.0:1789302458.603027:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302458.603102:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101579776 00000100:00100000:0.0:1789302458.603241:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101579776 00000100:00100000:0.0:1789302458.603360:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 40 00000100:00100000:0.0:1789302458.603371:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+19:15603:x1876219101579776:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:0.0:1789302458.603414:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302458.603442:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f800/0x1ff82925bd39aae7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f52 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302458.603585:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538ee00/0x1ff82925bd39aaee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302458.603615:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538ee00/0x1ff82925bd39aaee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302458.603631:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538ee00/0x1ff82925bd39aaee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302458.603646:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789302458.603781:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f800/0x1ff82925bd39aae7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f52 expref: 22 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302458.603805:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538ee00/0x1ff82925bd39aaee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f52 expref: 21 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302458.603814:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:0.0:1789302458.603816:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302458.603821:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538ee00, rc 0) 00000100:00100000:0.0:1789302458.603913:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+21:15603:x1876219101579776:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 543us (911us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789302458.603922:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 40 00000100:00100000:2.0:1789302458.607024:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.607336:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101579904 00000100:00100000:3.0:1789302458.607350:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101579904 00000100:00100000:3.0:1789302458.607432:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 41 00000100:00100000:3.0:1789302458.607445:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+21:15603:x1876219101579904:12345-192.168.203.9@tcp:54:lfs.0 00010000:00010000:3.0:1789302458.607536:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aafc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.607557:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aafc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.607572:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aafc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.607619:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aafc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.607647:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aafc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.607655:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aafc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.607661:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480030200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302458.607667:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aafc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.607675:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aafc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.608791:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:3.0:1789302458.608798:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302458.608806:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aafc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.608814:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39aafc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302458.608946:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+21:15603:x1876219101579904:12345-192.168.203.9@tcp:54:lfs.0 Request processed in 1499us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302458.608957:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 41 00000100:00100000:0.0:1789302458.609077:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302458.609232:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101580032 00000100:00100000:3.0:1789302458.609242:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101580032 00000100:00100000:3.0:1789302458.609494:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 0 00000100:00100000:3.0:1789302458.609505:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+21:2396:x1876219101580032:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302458.609521:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302458.609556:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538ee00/0x1ff82925bd39aaee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f52 expref: 21 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302458.609570:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:3.0:1789302458.609574:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302458.609612:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+20:2396:x1876219101580032:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 110us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302458.609619:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 0 00000100:00100000:0.0:1789302458.616981:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302458.617106:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101580288 00000100:00100000:1.0:1789302458.617156:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101580288 00000100:00100000:1.0:1789302458.617227:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 7 00000100:00100000:1.0:1789302458.617239:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+20:15603:x1876219101580288:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:1.0:1789302458.617534:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+21:15603:x1876219101580288:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 296us (566us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789302458.617566:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 7 00010000:00010000:1.0:1789302458.902340:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302458.967589:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121589632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302458.967691:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302458.967818:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121589632 00000100:00100000:2.0:1789302458.967845:0:18620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121589632 00000100:00100000:2.0:1789302458.967935:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789302458.967947:0:18620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121589632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302458.967985:0:18620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789302458.968054:0:18620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121589632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302458.968061:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789302458.968133:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121589632:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789302458.968261:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302459.061816:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302459.062729:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101580544 00000100:00100000:1.0:1789302459.062746:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101580544 00000100:00100000:1.0:1789302459.062852:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 42 00000100:00100000:1.0:1789302459.062866:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+21:15634:x1876219101580544:12345-192.168.203.9@tcp:101:cat.0 00010000:00010000:1.0:1789302459.062897:0:18366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302459.062923:0:18366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f59 expref: -99 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.063069:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39ab0a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.063086:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39ab0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.063101:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39ab0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302459.063153:0:18366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00080000:3.0:1789302459.063289:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789302459.063322:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab03 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f59 expref: 24 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.063344:0:18366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39ab0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f59 expref: 23 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.063375:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302459.063378:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302459.063382:0:18366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aa200, rc 0) 00000100:00100000:1.0:1789302459.063460:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+23:15634:x1876219101580544:12345-192.168.203.9@tcp:101:cat.0 Request processed in 598us (1662us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789302459.063471:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 42 00000100:00100000:0.0:1789302459.075910:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302459.075976:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302459.076297:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101580672 00000100:00100000:2.0:1789302459.076311:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101580672 00000100:00100000:2.0:1789302459.076401:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 1 00000100:00100000:2.0:1789302459.076414:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+23:2397:x1876219101580672:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302459.076434:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302459.076469:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39ab0a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f59 expref: 23 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.076503:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:2.0:1789302459.076510:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302459.076607:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+22:2397:x1876219101580672:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 195us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302459.076616:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 1 00000100:00100000:1.0:1789302459.076915:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101580928 00000100:00100000:1.0:1789302459.076920:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101580928 00000100:00100000:1.0:1789302459.076965:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 8 00000100:00100000:1.0:1789302459.076975:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+22:15634:x1876219101580928:12345-192.168.203.9@tcp:35:cat.0 00000100:00100000:1.0:1789302459.077388:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+23:15634:x1876219101580928:12345-192.168.203.9@tcp:35:cat.0 Request processed in 413us (1409us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789302459.077396:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 8 00000100:00100000:0.0:1789302459.195572:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302459.196071:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101581184 00000100:00100000:3.0:1789302459.196085:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101581184 00000100:00100000:3.0:1789302459.196336:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 43 00000100:00100000:3.0:1789302459.196351:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+23:15640:x1876219101581184:12345-192.168.203.9@tcp:101:dd.0 00010000:00010000:3.0:1789302459.196540:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302459.196569:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab18 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f60 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302459.196703:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39ab1f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302459.196720:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39ab1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302459.196735:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39ab1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302459.196749:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789302459.196922:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab18 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f60 expref: 26 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302459.196970:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39ab1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f60 expref: 25 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302459.196980:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:3.0:1789302459.196984:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302459.196988:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc480031400, rc 0) 00000100:00100000:3.0:1789302459.197078:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+25:15640:x1876219101581184:12345-192.168.203.9@tcp:101:dd.0 Request processed in 730us (1521us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789302459.197086:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 43 00000100:00100000:0.0:1789302459.211631:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302459.211780:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302459.212990:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101581440 00000100:00100000:2.0:1789302459.213016:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101581440 00000100:00100000:2.0:1789302459.213166:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 2 00000100:00100000:2.0:1789302459.213180:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+25:2396:x1876219101581440:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302459.213223:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302459.213258:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39ab1f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f60 expref: 25 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.213283:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:2.0:1789302459.213290:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302459.213376:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+24:2396:x1876219101581440:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 199us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302459.213383:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 2 00000100:00100000:1.0:1789302459.217014:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101581312 00000100:00100000:1.0:1789302459.217036:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101581312 00000100:00100000:1.0:1789302459.217263:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 44 00000100:00100000:1.0:1789302459.217278:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+24:15640:x1876219101581312:12345-192.168.203.9@tcp:101:dd.0 00010000:00010000:1.0:1789302459.217310:0:18366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302459.217338:0:18366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab2d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f67 expref: -99 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.217386:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd39ab34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.217633:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd39ab34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.217674:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd39ab34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.217839:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f67 expref: 26 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.218055:0:18366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd39ab34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f67 expref: 25 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.218066:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302459.218069:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302459.218073:0:18366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839ab000, rc 0) 00000100:00100000:1.0:1789302459.218411:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+25:15640:x1876219101581312:12345-192.168.203.9@tcp:101:dd.0 Request processed in 1123us (7288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302459.218421:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 44 00000100:00100000:0.0:1789302459.226786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302459.227022:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101581696 00000100:00100000:1.0:1789302459.227037:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101581696 00000100:00100000:1.0:1789302459.227424:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 45 00000100:00100000:1.0:1789302459.227438:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+25:15640:x1876219101581696:12345-192.168.203.9@tcp:36:dd.0 00010000:00010000:1.0:1789302459.227530:0:17112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302459.227567:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39aad2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f44 expref: 25 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.227592:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302459.227598:0:17112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302459.227821:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.227869:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.227882:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789302459.227942:0:17112:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789302459.227985:0:17112:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b717065d reply state 000000002af13068 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.228008:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.228015:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302459.228018:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789302459.228021:0:17112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302459.228202:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+27:15640:x1876219101581696:12345-192.168.203.9@tcp:36:dd.0 Request processed in 766us (1430us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789302459.228210:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 45 00000020:00080000:1.0:1789302459.228217:0:17112:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789302459.358962:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302459.359082:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101581952 00000100:00100000:1.0:1789302459.359096:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101581952 00000100:00100000:1.0:1789302459.359212:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 9 00000100:00100000:1.0:1789302459.359224:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+27:15640:x1876219101581952:12345-192.168.203.9@tcp:35:dd.0 00000100:00100000:1.0:1789302459.360228:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+28:15640:x1876219101581952:12345-192.168.203.9@tcp:35:dd.0 Request processed in 999us (1273us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1789302459.360240:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 9 00000100:00100000:0.0:1789302459.480147:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121589760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789302459.480242:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302459.480796:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121589888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302459.480840:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302459.481007:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121589760 00000100:00100000:2.0:1789302459.481018:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121589760 00000100:00100000:2.0:1789302459.481085:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121589888 00000100:00100000:2.0:1789302459.481089:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121589888 00000100:00100000:2.0:1789302459.481109:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789302459.481147:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121589760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789302459.481192:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789302459.481246:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876219121589760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302459.481253:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789302459.481273:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789302459.481279:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121589888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789302459.481299:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789302459.481331:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121589888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302459.481337:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789302459.481540:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876219121589760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789302459.482187:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121589888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789302459.620891:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302459.621069:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101582080 00000100:00100000:2.0:1789302459.621102:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101582080 00000100:00100000:2.0:1789302459.621224:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 46 00000100:00100000:2.0:1789302459.621237:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+28:15654:x1876219101582080:12345-192.168.203.9@tcp:101:stat.0 00010000:00010000:2.0:1789302459.621270:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302459.621301:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39ab42 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f6e expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.621387:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab49 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.621406:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.621421:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.621433:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.621441:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.621448:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.622672:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ab57 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.622696:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.622707:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302459.622886:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789302459.622892:0:17110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302459.622949:0:17110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.622967:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ab57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.622978:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.622986:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab49 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623004:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623011:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302459.623017:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623026:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab49 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623042:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:2.0:1789302459.623046:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302459.623052:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab49 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623871:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab49 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623917:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623925:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab50 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623932:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623938:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302459.623942:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623951:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab50 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623964:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cc381fa8100) 00010000:00010000:2.0:1789302459.623967:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302459.623971:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab50 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.623978:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.624040:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39ab42 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f6e expref: 30 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.624695:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ab57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f6e expref: 29 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302459.624741:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:2.0:1789302459.624744:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302459.624747:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349200, rc 0) 00000100:00100000:2.0:1789302459.624855:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+29:15654:x1876219101582080:12345-192.168.203.9@tcp:101:stat.0 Request processed in 3617us (3976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302459.624866:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 46 00000100:00100000:0.0:1789302459.734597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302459.734884:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101582336 00000100:00100000:3.0:1789302459.734898:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101582336 00000100:00100000:3.0:1789302459.734987:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 47 00000100:00100000:3.0:1789302459.735009:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+29:15660:x1876219101582336:12345-192.168.203.9@tcp:36:truncate.0 00010000:00010000:3.0:1789302459.735088:0:17111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302459.735193:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ab57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f6e expref: 29 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302459.735505:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:3.0:1789302459.735514:0:17111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302459.735948:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302459.735987:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302459.736011:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302459.736066:0:17111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1789302459.736091:0:17111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bd02a16 reply state 00000000884eebe6 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302459.736105:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302459.736382:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:3.0:1789302459.736386:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302459.736389:0:17111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302459.736565:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+31:15660:x1876219101582336:12345-192.168.203.9@tcp:36:truncate.0 Request processed in 1555us (1979us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789302459.736576:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 47 00000020:00080000:3.0:1789302459.736583:0:17111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789302459.924459:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302459.982407:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302459.982634:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101582464 00000100:00100000:1.0:1789302459.982667:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101582464 00000100:00100000:1.0:1789302459.982764:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 48 00000100:00100000:1.0:1789302459.982776:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+31:15674:x1876219101582464:12345-192.168.203.9@tcp:101:stat.0 00010000:00010000:1.0:1789302459.982808:0:18366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302459.982838:0:18366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ab65 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f75 expref: -99 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.982948:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ab6c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.982967:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ab6c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.982985:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ab6c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983010:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ab73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983017:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ab73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983024:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ab73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983477:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983489:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983567:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302459.983635:0:18366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1789302459.983640:0:18366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302459.983669:0:18366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983790:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983803:0:18366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ab6c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983810:0:18366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ab6c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983817:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ab6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983823:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302459.983827:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ab6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983835:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ab6c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983849:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:1.0:1789302459.983853:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302459.983859:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ab6c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983865:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ab6c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983894:0:18366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ab73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983900:0:18366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ab73 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983905:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ab73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983910:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302459.983913:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ab73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983919:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ab73 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983926:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cc381fa8100) 00010000:00010000:1.0:1789302459.983929:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302459.983931:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ab73 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983937:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ab73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983973:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ab65 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f75 expref: 33 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.983999:0:18366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f75 expref: 32 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302459.984019:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302459.984021:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302459.984024:0:18366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839ab800, rc 0) 00000100:00100000:1.0:1789302459.984364:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+32:15674:x1876219101582464:12345-192.168.203.9@tcp:101:stat.0 Request processed in 1588us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302459.984375:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 48 00000100:00100000:2.0:1789302460.094520:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.094639:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101582720 00000100:00100000:1.0:1789302460.094650:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101582720 00000100:00100000:1.0:1789302460.094724:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 49 00000100:00100000:1.0:1789302460.094745:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+32:15684:x1876219101582720:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:1.0:1789302460.094775:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302460.094803:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ab81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f7c expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302460.095103:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789302460.095406:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ab81 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f7c expref: 34 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.095424:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383963600) 00010000:00010000:1.0:1789302460.095428:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302460.095434:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ab81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f7c expref: 34 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.095457:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aa800, rc 0) 00000100:00100000:1.0:1789302460.095621:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+33:15684:x1876219101582720:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 887us (1117us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1789302460.095654:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 49 00000100:00100000:0.0:1789302460.101060:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302460.101325:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101582976 00000100:00100000:3.0:1789302460.101338:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101582976 00000100:00100000:3.0:1789302460.101629:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 10 00000100:00100000:3.0:1789302460.101644:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4a8babc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+33:15684:x1876219101582976:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:3.0:1789302460.102053:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4a8babc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+34:15684:x1876219101582976:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 410us (1007us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789302460.102062:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 10 00000100:00100000:0.0:1789302460.197772:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.197936:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101583232 00000100:00100000:2.0:1789302460.197948:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101583232 00000100:00100000:2.0:1789302460.198030:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 50 00000100:00100000:2.0:1789302460.198041:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+34:15690:x1876219101583232:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:2.0:1789302460.198075:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302460.198105:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab8f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f83 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.198315:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.198334:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39aabd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f3d expref: 35 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.198345:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f75 expref: 35 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.198356:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.198423:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f75 expref: 35 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.198438:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f75 expref: 35 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302460.198456:0:17110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17110:1876219121590016:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302460.198575:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39aabd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f3d expref: 35 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.198584:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39aabd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f3d expref: 35 pid: 17111 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302460.198593:0:17110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17110:1876219121590144:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302460.198618:0:17110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b91d6300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302460.206348:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.206455:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302460.206553:0:17110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17110:1876219121590016:192.168.203.9@tcp:104: 00000100:00100000:0.0:1789302460.206569:0:17110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17110:1876219121590144:192.168.203.9@tcp:104: 00010000:00010000:0.0:1789302460.206606:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302460.217534:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101583360 00000100:00100000:3.0:1789302460.217579:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101583360 00010000:00010000:0.0:1789302460.217874:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f75 expref: 36 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302460.217948:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101583488 00000100:00100000:0.0:1789302460.217953:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101583488 00010000:00010000:0.0:1789302460.217976:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39aabd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f3d expref: 37 pid: 17111 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302460.218007:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:0.0:1789302460.218017:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+37:2398:x1876219101583360:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302460.218036:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302460.218044:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f75 expref: 37 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218059:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f75 expref: 37 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218086:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab800/0x1ff82925bd39ab7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f75 expref: 37 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218108:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:0.0:1789302460.218166:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218177:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218184:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302460.218267:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+36:2398:x1876219101583360:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 251us (11935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302460.218275:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 17 00000100:00100000:0.0:1789302460.218337:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 18 00000100:00100000:0.0:1789302460.218344:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+35:2398:x1876219101583488:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302460.218359:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302460.218364:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39aabd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f3d expref: 35 pid: 17111 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218374:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39aabd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f3d expref: 35 pid: 17111 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218385:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39aabd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f3d expref: 35 pid: 17111 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218396:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:0.0:1789302460.218399:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218409:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218416:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218442:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302460.218461:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+34:2398:x1876219101583488:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 117us (12006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302460.218467:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 18 00010000:00010000:0.0:1789302460.218647:0:17110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218656:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302460.218694:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1789302460.218866:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ab8f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f83 expref: 35 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218882:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f83 expref: 34 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.218890:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:0.0:1789302460.218893:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789302460.218895:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5348e00, rc 0) 00000100:00100000:0.0:1789302460.218928:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+34:15690:x1876219101583232:12345-192.168.203.9@tcp:101:bash.0 Request processed in 20890us (21171us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1789302460.218936:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 50 00000100:00100000:2.0:1789302460.221491:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302460.221703:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101583744 00000100:00100000:3.0:1789302460.221716:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101583744 00000100:00100000:3.0:1789302460.221784:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 51 00000100:00100000:3.0:1789302460.221798:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+34:15690:x1876219101583744:12345-192.168.203.9@tcp:36:bash.0 00010000:00010000:3.0:1789302460.222776:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.222803:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.222820:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302460.222903:0:17111:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1789302460.222938:0:17111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e40ea8a reply state 0000000037a1eaca transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.222952:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.222961:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:3.0:1789302460.222964:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789302460.222969:0:17111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302460.223292:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+37:15690:x1876219101583744:12345-192.168.203.9@tcp:36:bash.0 Request processed in 1493us (1809us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1789302460.223302:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 51 00000020:00080000:3.0:1789302460.223310:0:17111:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789302460.229207:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.229319:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101583872 00000100:00100000:1.0:1789302460.229332:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101583872 00000100:00100000:1.0:1789302460.229410:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:1.0:1789302460.229423:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+37:15690:x1876219101583872:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1789302460.229455:0:18366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302460.229481:0:18366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39abab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f8a expref: -99 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.229559:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39abab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f8a expref: 38 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.229577:0:18366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39abab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f8a expref: 38 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.229600:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302460.229603:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302460.229608:0:18366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839aa800, rc 0) 00000100:00100000:1.0:1789302460.229690:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+38:15690:x1876219101583872:12345-192.168.203.9@tcp:101:bash.0 Request processed in 269us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302460.229698:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 52 00000100:00100000:0.0:1789302460.239906:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.240204:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101584000 00000100:00100000:1.0:1789302460.240218:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101584000 00000100:00100000:1.0:1789302460.240302:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 53 00000100:00100000:1.0:1789302460.240316:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+38:15690:x1876219101584000:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1789302460.240344:0:17112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302460.240406:0:17112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39abb2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f91 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.240537:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.240557:0:17112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f83 expref: 39 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.240570:0:17112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abb9 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.240633:0:17112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f83 expref: 39 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.240649:0:17112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f83 expref: 39 pid: 17110 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302460.240666:0:17112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7eec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17112:1876219121590272:192.168.203.9@tcp:104: 00000100:00100000:1.0:1789302460.240789:0:17112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc490ed23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302460.266429:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302460.266700:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101584128 00000100:00100000:0.0:1789302460.266712:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101584128 00010000:00010000:0.0:1789302460.266767:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f83 expref: 40 pid: 17110 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302460.266816:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 19 00000100:00100000:0.0:1789302460.266828:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+40:2399:x1876219101584128:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302460.266846:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302460.266854:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f83 expref: 40 pid: 17110 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.267026:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f83 expref: 40 pid: 17110 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.267057:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:0.0:1789302460.267063:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.267076:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.267085:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abb9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.267156:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302460.267229:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+40:2399:x1876219101584128:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 402us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302460.267237:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 19 00010000:00010000:1.0:1789302460.270272:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ab96 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f83 expref: 39 pid: 17110 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302460.270308:0:17112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7eec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17112:1876219121590272:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302460.270341:0:17112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.270354:0:17112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.270392:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302460.270471:0:17112:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789302460.270477:0:17112:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789302460.270511:0:17112:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.270558:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39abb2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f91 expref: 39 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.270576:0:17112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f91 expref: 38 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.270587:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302460.270590:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302460.270594:0:17112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839ab600, rc 0) 00000100:00100000:1.0:1789302460.270692:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+38:15690:x1876219101584000:12345-192.168.203.9@tcp:101:bash.0 Request processed in 30378us (30820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302460.270701:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 53 00000100:00100000:2.0:1789302460.279041:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.279160:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101584384 00000100:00100000:1.0:1789302460.279173:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101584384 00000100:00100000:1.0:1789302460.279249:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:1.0:1789302460.279261:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384295f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+38:15690:x1876219101584384:12345-192.168.203.9@tcp:103:bash.0 00010000:00010000:1.0:1789302460.279281:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789302460.279314:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39abab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f8a expref: 38 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.279368:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abb9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f91 expref: 37 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.279379:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302460.279385:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302460.279460:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384295f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+36:15690:x1876219101584384:12345-192.168.203.9@tcp:103:bash.0 Request processed in 202us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302460.279468:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 3 00000100:00100000:0.0:1789302460.290168:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.290284:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101584512 00000100:00100000:1.0:1789302460.290298:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101584512 00000100:00100000:1.0:1789302460.290374:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 54 00000100:00100000:1.0:1789302460.290388:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+36:15690:x1876219101584512:12345-192.168.203.9@tcp:58:bash.0 00010000:00010000:1.0:1789302460.290534:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.290558:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.290574:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302460.302773:0:18366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302460.303827:0:18366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789302460.304183:0:18366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789302460.304383:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+36:15690:x1876219101584512:12345-192.168.203.9@tcp:58:bash.0 Request processed in 13989us (14262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302460.304399:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 54 00000100:00100000:2.0:1789302460.328624:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302460.328832:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101584640 00000100:00100000:3.0:1789302460.328846:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101584640 00000100:00100000:3.0:1789302460.328929:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 55 00000100:00100000:3.0:1789302460.328940:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+36:15690:x1876219101584640:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:3.0:1789302460.328996:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302460.329024:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39abc7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f98 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.329095:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.329107:0:17111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39abc7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f98 expref: 37 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.329151:0:17111:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.329166:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39abc7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f98 expref: 37 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.329182:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:3.0:1789302460.329186:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302460.329189:0:17111:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39abc7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f98 expref: 37 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.329198:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc480031c00, rc 0) 00000100:00100000:3.0:1789302460.329276:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+37:15690:x1876219101584640:12345-192.168.203.9@tcp:101:bash.0 Request processed in 338us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302460.329283:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 55 00000040:00080000:3.0:1789302460.374085:0:17144:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789302460.374101:0:17144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302460.374168:0:17144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789302460.374188:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789302460.374393:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17144:1876219121590400:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789302460.375142:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302460.382396:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17144:1876219121590400:192.168.203.9@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789302460.388619:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.389347:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101584768 00000100:00100000:2.0:1789302460.389361:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101584768 00000100:00100000:2.0:1789302460.389453:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 56 00000100:00100000:2.0:1789302460.389466:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+37:15691:x1876219101584768:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789302460.389510:0:17110:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789302460.389858:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+37:15691:x1876219101584768:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 393us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302460.389867:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 56 00000100:00100000:2.0:1789302460.393739:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302460.393840:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101584896 00000100:00100000:3.0:1789302460.393855:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101584896 00000100:00100000:3.0:1789302460.393951:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 57 00000100:00100000:3.0:1789302460.393965:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc384297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+37:15691:x1876219101584896:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789302460.394075:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39abce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394098:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39abce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394141:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39abce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394631:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39abd5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394656:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39abd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394669:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39abd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394702:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39abdc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394712:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39abdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394735:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39abdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302460.394791:0:17111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789302460.394795:0:17111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789302460.394809:0:17111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39abdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394820:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39abce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394827:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39abce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394833:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39abce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394838:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480030400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302460.394843:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39abce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394850:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39abce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394862:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc381fa8b00) 00010000:00010000:3.0:1789302460.394865:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302460.394871:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39abce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394877:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030400/0x1ff82925bd39abce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394906:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39abd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394913:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39abd5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394919:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39abd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394924:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480031400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302460.394928:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39abd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394935:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39abd5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.394943:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8cc381fa8e00) 00010000:00010000:3.0:1789302460.394945:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302460.395078:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39abd5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.395086:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031400/0x1ff82925bd39abd5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.395105:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39abdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.395187:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39abdc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.395193:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39abdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.395204:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480030800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:3.0:1789302460.395207:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39abdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.395213:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39abdc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.395222:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:3.0:1789302460.395224:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302460.395227:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39abdc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.395233:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030800/0x1ff82925bd39abdc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302460.395343:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc384297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+37:15691:x1876219101584896:12345-192.168.203.9@tcp:34:lhsmtool_posix.0 Request processed in 1377us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302460.395353:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 57 00000100:00100000:3.0:1789302460.400782:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.405604:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101585152 00000100:00100000:2.0:1789302460.405619:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101585152 00000100:00100000:2.0:1789302460.405679:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 58 00000100:00100000:2.0:1789302460.405690:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+37:15691:x1876219101585152:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302460.405709:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302460.405731:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39abe3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5f9f expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.405833:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.405848:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.405861:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302460.405871:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789302460.405962:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.405983:0:17110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.406000:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.406006:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302460.406010:0:17110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.406017:0:17110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.406029:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:2.0:1789302460.406031:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302460.406036:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.406042:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.406086:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39abe3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f9f expref: 39 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.406095:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cc381fa8b00) 00010000:00010000:2.0:1789302460.406098:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302460.406101:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39abe3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f9f expref: 39 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.406227:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349400, rc 0) 00000100:00100000:2.0:1789302460.406427:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+38:15691:x1876219101585152:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 738us (6093us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1789302460.406436:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 58 00000100:00100000:0.0:1789302460.421619:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.421716:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101585280 00000100:00100000:1.0:1789302460.421726:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101585280 00000100:00100000:1.0:1789302460.421787:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 59 00000100:00100000:1.0:1789302460.421799:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+38:15691:x1876219101585280:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789302460.421835:0:17112:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789302460.421964:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+38:15691:x1876219101585280:12345-192.168.203.9@tcp:53:lhsmtool_posix.0 Request processed in 167us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302460.421994:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 59 00000100:00100000:0.0:1789302460.425776:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.425924:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101585536 00000100:00100000:2.0:1789302460.425938:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101585536 00000100:00100000:2.0:1789302460.426020:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:2.0:1789302460.426032:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+38:15691:x1876219101585536:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302460.426061:0:18366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302460.426092:0:18366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abf8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5fa6 expref: -99 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302460.426649:0:18366:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1789302460.426658:0:18366:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789302460.426683:0:18366:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789302460.426868:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39abff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.426886:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39abff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.426899:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39abff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.426974:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39abf8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fa6 expref: 41 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.427015:0:18366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39abff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fa6 expref: 40 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.427047:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc486113700) 00010000:00010000:2.0:1789302460.427050:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302460.427054:0:18366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349c00, rc 0) 00000100:00100000:2.0:1789302460.427660:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+40:15691:x1876219101585536:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1624us (1892us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789302460.427672:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 60 00000100:00100000:2.0:1789302460.437647:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.441557:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101585792 00000100:00100000:1.0:1789302460.441574:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101585792 00000100:00100000:1.0:1789302460.441647:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:1.0:1789302460.441658:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+40:15691:x1876219101585792:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302460.441729:0:17112:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302460.441755:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349c00/0x1ff82925bd39abff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fa6 expref: 40 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441776:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc486113700) 00010000:00010000:1.0:1789302460.441786:0:17112:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302460.441810:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac0d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441826:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441837:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441851:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xee71e003 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441857:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee71e003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441863:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee71e003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441923:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac0d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441931:0:17112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac0d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441937:0:17112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441954:0:17112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302460.441959:0:17112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac0d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441967:0:17112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac0d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441976:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:1.0:1789302460.441979:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302460.441983:0:17112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac0d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.441998:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac0d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.442009:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee71e003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.442018:0:17112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac14 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee71e003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.442024:0:17112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee71e003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.442037:0:17112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302460.442040:0:17112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac14 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee71e003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.442046:0:17112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac14 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xee71e003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.442054:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xee71e003 (ffff8cc383963c00) 00010000:00010000:1.0:1789302460.442056:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302460.442058:0:17112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac14 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xee71e003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.442064:0:17112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac14 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xee71e003 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302460.442203:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+39:15691:x1876219101585792:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 545us (4570us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302460.442211:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 61 00000100:00100000:3.0:1789302460.449426:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302460.449691:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101585920 00000100:00100000:0.0:1789302460.449703:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101585920 00000100:00100000:0.0:1789302460.449840:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 62 00000100:00100000:0.0:1789302460.449853:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+39:15691:x1876219101585920:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302460.449874:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302460.449898:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f800/0x1ff82925bd39ac1b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5fad expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.450089:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538ea00/0x1ff82925bd39ac22 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.450104:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538ea00/0x1ff82925bd39ac22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.450197:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538ea00/0x1ff82925bd39ac22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.450310:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538f800/0x1ff82925bd39ac1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fad expref: 41 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.450331:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538ea00/0x1ff82925bd39ac22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fad expref: 40 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.450338:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc381fa3f00) 00010000:00010000:0.0:1789302460.450341:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789302460.450344:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538ea00, rc 0) 00000100:00100000:0.0:1789302460.450616:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+40:15691:x1876219101585920:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 764us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302460.450624:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 62 00000100:00100000:0.0:1789302460.453700:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.453790:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101586176 00000100:00100000:1.0:1789302460.453801:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101586176 00000100:00100000:1.0:1789302460.453863:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:1.0:1789302460.453873:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+40:15691:x1876219101586176:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302460.453963:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.453980:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.454003:0:17112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789302460.454235:0:17112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1789302460.454246:0:17112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 536497133373ns, next at 537497129572ns, rc = 0 00000004:00010000:1.0:1789302460.454299:0:17112:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006166324e reply state 000000002c768055 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.454312:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.454320:0:17112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc381fa3f00) 00010000:00010000:1.0:1789302460.454323:0:17112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789302460.454328:0:17112:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302460.454431:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+42:15691:x1876219101586176:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 559us (740us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1789302460.454438:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 63 00000100:00100000:2.0:1789302460.471048:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302460.471190:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101586304 00000100:00100000:0.0:1789302460.471209:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101586304 00000100:00100000:0.0:1789302460.471266:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 64 00000100:00100000:0.0:1789302460.471276:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+42:15691:x1876219101586304:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302460.471298:0:18366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302460.471334:0:18366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac30 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5fb4 expref: -99 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.472463:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac30 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fb4 expref: 43 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.472486:0:18366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac30 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fb4 expref: 43 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.472514:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc381fa3f00) 00010000:00010000:0.0:1789302460.472517:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302460.472521:0:18366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538fa00, rc 0) 00000100:00100000:0.0:1789302460.472585:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+43:15691:x1876219101586304:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 1310us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302460.472594:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 64 00000100:00100000:3.0:1789302460.477156:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.479079:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101586432 00000100:00100000:1.0:1789302460.479093:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101586432 00000100:00100000:1.0:1789302460.479222:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00100000:1.0:1789302460.479235:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2398:x1876219101586432:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789302460.479629:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+6:2398:x1876219101586432:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 396us (2520us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789302460.479638:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 24 00000100:00080000:3.0:1789302460.480865:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302460.496064:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302460.496162:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101586688 00000100:00100000:0.0:1789302460.496171:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101586688 00000100:00100000:0.0:1789302460.496288:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 11 00000100:00100000:0.0:1789302460.496300:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+43:15691:x1876219101586688:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789302460.498087:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+44:15691:x1876219101586688:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 1782us (2026us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789302460.498100:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 11 00000100:00100000:0.0:1789302460.505582:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.515061:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101586944 00000100:00100000:1.0:1789302460.515076:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101586944 00000100:00100000:1.0:1789302460.515408:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 65 00000100:00100000:1.0:1789302460.515421:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4adc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+44:15691:x1876219101586944:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789302460.515555:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4adc89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+44:15691:x1876219101586944:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 138us (9982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302460.515564:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 65 00000100:00100000:0.0:1789302460.523830:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.524000:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101587072 00000100:00100000:2.0:1789302460.524010:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101587072 00000100:00100000:2.0:1789302460.524090:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 66 00000100:00100000:2.0:1789302460.524100:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+44:15691:x1876219101587072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302460.524138:0:18366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302460.524161:0:18366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5fbb expref: -99 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.524328:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ac3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.524343:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ac3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.524354:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ac3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302460.524408:0:18366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789302460.524427:0:18366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ac3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.524470:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac37 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fbb expref: 46 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.524488:0:18366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ac3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fbb expref: 45 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.524497:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc381fa3f00) 00010000:00010000:2.0:1789302460.524500:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789302460.524505:0:18366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349200, rc 0) 00000100:00100000:2.0:1789302460.524574:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc383a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+45:15691:x1876219101587072:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 475us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302460.524581:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 66 00000100:00100000:2.0:1789302460.529808:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302460.529884:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101587200 00000100:00100000:3.0:1789302460.529894:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101587200 00000100:00100000:3.0:1789302460.529949:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:3.0:1789302460.529959:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+6:2396:x1876219101587200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302460.529978:0:19064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302460.530009:0:19064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec2cf085/0x1ff82925bd39ac45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5fc2 expref: -99 pid: 19064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302460.530050:0:19064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa696bc, blocks: 0x0 00010000:00010000:3.0:1789302460.530071:0:19064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=536s v=(0 0) 00010000:00010000:3.0:1789302460.530076:0:19064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302460.530085:0:19064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec2cf085/0x1ff82925bd39ac45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc2 expref: 7 pid: 19064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.530104:0:19064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec2cf085/0x1ff82925bd39ac45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc2 expref: 7 pid: 19064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.530144:0:19064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc480030800, rc 0) 00000100:00100000:3.0:1789302460.530256:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+7:2396:x1876219101587200:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 298us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302460.530263:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 25 00000100:00100000:3.0:1789302460.548877:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.549162:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101587456 00000100:00100000:1.0:1789302460.549171:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101587456 00000100:00100000:1.0:1789302460.549225:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 67 00000100:00100000:1.0:1789302460.549234:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+45:15691:x1876219101587456:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789302460.549335:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+45:15691:x1876219101587456:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 101us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302460.549343:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 67 00000100:00100000:1.0:1789302460.551374:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302460.557891:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101587584 00000100:00100000:0.0:1789302460.557908:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101587584 00000100:00100000:0.0:1789302460.557999:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 68 00000100:00100000:0.0:1789302460.558176:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+45:15691:x1876219101587584:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789302460.561693:0:17090:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1789302460.561712:0:17090:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789302460.561780:0:17090:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1789302460.561965:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.561979:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.562004:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.562020:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480031600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:2.0:1789302460.562025:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.562032:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.562057:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:2.0:1789302460.562060:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789302460.562065:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.562071:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031600/0x1ff82925bd39aa5b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302460.562463:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+20:15691:x1876219101587584:12345-192.168.203.9@tcp:44:lhsmtool_posix.0 Request processed in 4447us (11088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302460.562474:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 68 00000100:00100000:2.0:1789302460.562708:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302460.562730:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121590528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789302460.562789:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302460.562840:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121590528 00000100:00100000:2.0:1789302460.562848:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121590528 00000100:00100000:2.0:1789302460.562898:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789302460.562907:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121590528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789302460.563067:0:18616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789302460.563071:0:18616:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789302460.563073:0:18616:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789302460.563074:0:18616:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789302460 -> 1789302460 00002000:00010000:2.0:1789302460.563076:0:18616:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789302460.563109:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1876219121590528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 202us (319us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789302460.563133:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789302460.563152:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789302460.563181:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cc38489c380/2, rc 0, transno 8589934596 00000100:00100000:2.0:1789302460.563187:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121590528:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789302460.568847:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.568865:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.568873:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.568879:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982c00 already unused, calling callback (ffffffffc19e04f0) 00000100:00100000:2.0:1789302460.569302:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302460.569632:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101587712 00000100:00100000:3.0:1789302460.569642:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101587712 00000100:00100000:3.0:1789302460.569708:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 27 00000100:00100000:3.0:1789302460.569719:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+7:2398:x1876219101587712:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789302460.569827:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+7:2398:x1876219101587712:12345-192.168.203.9@tcp:16:lhsmtool_posix.0 Request processed in 110us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302460.569834:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 27 00010000:00010000:1.0:1789302460.570925:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.570941:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.570959:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cc381fa8700) 00010000:00010000:1.0:1789302460.570974:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302460.570980:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.570997:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982c00/0x1ff82925bd39aa07 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572359:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572373:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572390:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572397:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4aa982000 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302460.572400:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572406:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572419:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:1.0:1789302460.572422:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302460.572427:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572433:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4aa982000/0x1ff82925bd39aa0e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572452:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572472:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572476:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572481:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480031800 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302460.572484:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572489:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572498:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cc381fa8100) 00010000:00010000:1.0:1789302460.572500:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302460.572503:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572508:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031800/0x1ff82925bd39aab6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572523:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572529:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572534:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572539:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302460.572548:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572554:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572563:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302460.572565:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302460.572568:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572574:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab400/0x1ff82925bd39ab3b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572586:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572592:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572597:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572601:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480030200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302460.572604:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572610:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572617:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302460.572620:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302460.572629:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572636:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030200/0x1ff82925bd39ab5e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572649:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572654:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572659:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572677:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480030c00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302460.572680:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572686:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572694:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302460.572696:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302460.572699:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572704:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480030c00/0x1ff82925bd39aba4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572714:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572719:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572731:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572736:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302460.572739:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572746:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572754:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc381fa3f00) 00010000:00010000:1.0:1789302460.572757:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789302460.572760:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.572765:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa400/0x1ff82925bd39ac29 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17112 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302460.573211:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.573559:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101587968 00000100:00100000:1.0:1789302460.573569:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101587968 00000100:00100000:1.0:1789302460.573624:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 69 00000100:00100000:1.0:1789302460.573633:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+14:15691:x1876219101587968:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302460.573697:0:17111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302460.573716:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349200/0x1ff82925bd39ac3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fbb expref: 14 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.573729:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc381fa3f00) 00010000:00010000:1.0:1789302460.573732:0:17111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302460.573769:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac4c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.573782:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.573792:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302460.573928:0:17111:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021e2c7fe reply state 000000004357f499 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.573940:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa800/0x1ff82925bd39ac4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.573945:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc381fa3f00) 00010000:00010000:1.0:1789302460.573948:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789302460.573951:0:17111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302460.574069:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+15:15691:x1876219101587968:12345-192.168.203.9@tcp:36:lhsmtool_posix.0 Request processed in 436us (861us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1789302460.574076:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 69 00000100:00100000:3.0:1789302460.579499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.579642:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101588096 00000100:00100000:2.0:1789302460.579661:0:18616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101588096 00000100:00100000:2.0:1789302460.579729:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 28 00000100:00100000:2.0:1789302460.579741:0:18616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+7:15691:x1876219101588096:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302460.579759:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302460.579777:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5fc9 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.579810:0:18616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec2cf085/0x1ff82925bd39ac45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc2 expref: 8 pid: 19064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.579820:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302460.579825:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302460.579831:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 8 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.579864:0:18616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec2cf085/0x1ff82925bd39ac45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc2 expref: 8 pid: 19064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.579877:0:18616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec2cf085/0x1ff82925bd39ac45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc2 expref: 8 pid: 19064 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302460.579890:0:18616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18616:1876219121590656:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302460.579977:0:18616:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc490d496c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302460.584089:0:18616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18616:1876219121590656:192.168.203.9@tcp:104: 00010000:00010000:1.0:1789302460.584163:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 8 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.584184:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349400, rc 0) 00000100:00100000:1.0:1789302460.584240:0:18616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+8:15691:x1876219101588096:12345-192.168.203.9@tcp:101:lhsmtool_posix.0 Request processed in 4501us (4750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302460.584249:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 28 00000100:00100000:3.0:1789302460.585252:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.585435:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101588224 00000100:00100000:2.0:1789302460.585443:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101588224 00010000:00010000:2.0:1789302460.585486:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec2cf085/0x1ff82925bd39ac45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc2 expref: 8 pid: 19064 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302460.585519:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 20 00000100:00100000:2.0:1789302460.585528:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+8:2399:x1876219101588224:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302460.585540:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302460.585562:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec2cf085/0x1ff82925bd39ac45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc2 expref: 8 pid: 19064 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.585576:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec2cf085/0x1ff82925bd39ac45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc2 expref: 8 pid: 19064 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.585598:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec2cf085/0x1ff82925bd39ac45 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc2 expref: 8 pid: 19064 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.585614:0:17096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302460.585619:0:17096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302460.585626:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 7 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.585636:0:17096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 7 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.585689:0:17096:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 7 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302460.585718:0:17096:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17096:1876219121590784:192.168.203.9@tcp:105: 00000100:00100000:2.0:1789302460.585790:0:17096:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc490d49900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302460.597822:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.597895:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101588352 00000100:00100000:1.0:1789302460.597913:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101588352 00000100:00100000:2.0:1789302460.597915:0:17096:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17096:1876219121590784:192.168.203.9@tcp:105: 00010000:00010000:2.0:1789302460.597936:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302460.597970:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00100000:1.0:1789302460.597979:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+8:2399:x1876219101588352:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789302460.597993:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+8:2399:x1876219101588224:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 12459us (12737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302460.598001:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 20 00002000:00010000:1.0:1789302460.598154:0:19064:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789302460.598159:0:19064:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789302460 00002000:00010000:1.0:1789302460.598161:0:19064:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789302458 00002000:00010000:1.0:1789302460.598164:0:19064:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789302460 -> 1789302460 00002000:00010000:1.0:1789302460.598167:0:19064:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789302460.598195:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+8:2399:x1876219101588352:12345-192.168.203.9@tcp:2:lhsmtool_posix.0 Request processed in 216us (381us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789302460.598201:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00100000:1.0:1789302460.605189:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302460.605315:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101588480 00000100:00100000:3.0:1789302460.605333:0:18617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101588480 00000100:00100000:3.0:1789302460.605421:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:3.0:1789302460.605436:0:18617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+8:2398:x1876219101588480:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789302460.605496:0:18617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.605525:0:18617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 8 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.605535:0:18617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302460.605540:0:18617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302460.605546:0:18617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.605594:0:18617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 8 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.605611:0:18617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 8 pid: 18616 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302460.605634:0:18617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18617:1876219121590912:192.168.203.9@tcp:104: 00000100:00100000:3.0:1789302460.605794:0:18617:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4b53fc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302460.609238:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.609370:0:18617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18617:1876219121590912:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302460.609405:0:18617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302460.609542:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101588608 00000100:00100000:0.0:1789302460.609549:0:17095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101588608 00010000:00010000:0.0:1789302460.609589:0:17095:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 9 pid: 18616 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302460.609633:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 21 00000100:00100000:0.0:1789302460.609644:0:17095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+9:2399:x1876219101588608:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302460.609659:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302460.609682:0:17095:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 9 pid: 18616 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.609695:0:17095:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 9 pid: 18616 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.609722:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bd690e3/0x1ff82925bd39ac53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fc9 expref: 9 pid: 18616 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.609740:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302460.609745:0:17095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302460.609751:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.609779:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.609812:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302460.609883:0:17095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+8:2399:x1876219101588608:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 240us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302460.609890:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 21 00010000:00010000:2.0:1789302460.610498:0:18617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.610510:0:18617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.610533:0:18617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.610542:0:18617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.610567:0:18617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.610574:0:18617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc480031400 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:2.0:1789302460.610578:0:18617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.610587:0:18617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.610601:0:18617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.610610:0:18617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad7ae9ec/0x1ff82925bd39ac5a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302460.610676:0:18617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+7:2398:x1876219101588480:12345-192.168.203.9@tcp:1:lhsmtool_posix.0 Request processed in 5244us (5496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302460.610693:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:3.0:1789302460.624012:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.624171:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101588864 00000100:00100000:2.0:1789302460.624187:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101588864 00000100:00100000:2.0:1789302460.624269:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 70 00000100:00100000:2.0:1789302460.624281:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+15:15691:x1876219101588864:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789302460.624362:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.624403:0:18366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd39ab34 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f67 expref: 15 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.624414:0:18366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.624450:0:18366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd39ab34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f67 expref: 15 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.624463:0:18366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd39ab34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f67 expref: 15 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302460.624479:0:18366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18366:1876219121591040:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302460.624616:0:18366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc490d49900 going to sleep for 11 seconds 00000100:00100000:0.0:1789302460.628216:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.628620:0:18366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18366:1876219121591040:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302460.628654:0:18366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302460.628834:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101588992 00000100:00100000:3.0:1789302460.628850:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101588992 00010000:00010000:3.0:1789302460.628916:0:17096:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd39ab34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f67 expref: 16 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302460.628966:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 22 00000100:00100000:3.0:1789302460.628982:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+16:2399:x1876219101588992:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302460.629013:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302460.629023:0:17096:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd39ab34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f67 expref: 16 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.629039:0:17096:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd39ab34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f67 expref: 16 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.629077:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab000/0x1ff82925bd39ab34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f67 expref: 16 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.629098:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:3.0:1789302460.629105:0:17096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39abc7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f98 expref: 15 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.629189:0:17096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.629199:0:17096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.629228:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.629264:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302460.629296:0:18366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.629308:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302460.629352:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc38489c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+15:2399:x1876219101588992:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 373us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302460.629363:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 22 00010000:00010000:2.0:1789302460.630000:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.630031:0:18366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac30 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fb4 expref: 15 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.630048:0:18366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.630083:0:18366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac30 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fb4 expref: 15 pid: 18366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.630099:0:18366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac30 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fb4 expref: 15 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302460.630147:0:18366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18366:1876219121591168:192.168.203.9@tcp:104: 00000100:00100000:2.0:1789302460.630231:0:18366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc490d49cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302460.640791:0:18366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18366:1876219121591168:192.168.203.9@tcp:104: 00010000:00010000:2.0:1789302460.640822:0:18366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302460.641532:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302460.645315:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101589120 00000100:00100000:3.0:1789302460.645330:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101589120 00010000:00010000:3.0:1789302460.645376:0:17097:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac30 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fb4 expref: 16 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302460.645822:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 23 00000100:00100000:3.0:1789302460.645835:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4bdbe3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+16:2398:x1876219101589120:12345-192.168.203.9@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302460.645850:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302460.645858:0:17097:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac30 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fb4 expref: 16 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.645872:0:17097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac30 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fb4 expref: 16 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.645893:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac30 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fb4 expref: 16 pid: 18366 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.645910:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc381fa3f00) 00010000:00010000:3.0:1789302460.645915:0:17097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.645942:0:17097:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.645949:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302460.646105:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302460.646206:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4bdbe3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+15:2398:x1876219101589120:12345-192.168.203.9@tcp:103:ldlm_bl.0 Request processed in 375us (4677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302460.646214:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 23 00010000:00010000:2.0:1789302460.649850:0:18366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.649870:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302460.649994:0:18366:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1789302460.650594:0:18366:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1789302460.650631:0:18366:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1789302460.651553:0:18366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18366:1876219121591296:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789302460.651616:0:18366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302460.651771:0:18366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc490d49840 going to sleep for 11 seconds 00000100:00100000:0.0:1789302460.653812:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121591296 00000100:00100000:0.0:1789302460.653825:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121591296 00000100:00100000:2.0:1789302460.653970:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789302460.653980:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18366:x1876219121591296:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789302460.654182:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18366:x1876219121591296:12345-0@lo:1000:mdt00_003.0 Request processed in 202us (2564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302460.654190:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789302460.654298:0:18366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18366:1876219121591296:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789302460.655311:0:18366:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1789302460.655399:0:18366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18366:1876219121591424:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789302460.657440:0:18366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302460.657487:0:18366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302460.657704:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121591424 00000100:00100000:3.0:1789302460.657714:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121591424 00000100:00100000:3.0:1789302460.657768:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789302460.657780:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18366:x1876219121591424:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789302460.657992:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18366:x1876219121591424:12345-0@lo:1000:mdt00_003.0 Request processed in 206us (548us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789302460.658001:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789302460.658356:0:18366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc38489c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18366:1876219121591424:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789302460.658419:0:18366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658429:0:18366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658437:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658444:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5349400 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302460.658448:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658470:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658486:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc381fa3f00) 00010000:00010000:0.0:1789302460.658490:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302460.658496:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658502:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac68 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658534:0:18366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658541:0:18366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658547:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658552:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839ab600 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302460.658555:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658561:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658569:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:0.0:1789302460.658572:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302460.658578:0:18366:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39abc7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f98 expref: 18 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658601:0:18366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39abc7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f98 expref: 18 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658610:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39abc7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f98 expref: 18 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.658664:0:18366:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cc480031c00/0x1ff82925bd39abc7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5f98 expref: 18 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302460.658691:0:18366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7fad880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18366:1876219121591552:192.168.203.9@tcp:105: 00000100:00100000:0.0:1789302460.658769:0:18366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cc4bd95fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302460.666174:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302460.666282:0:18366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7fad880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18366:1876219121591552:192.168.203.9@tcp:105: 00010000:00010000:0.0:1789302460.666310:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666321:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39abc0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666355:0:18366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac6f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666369:0:18366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666380:0:18366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666402:0:18366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac6f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666422:0:18366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac6f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666429:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac6f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666434:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538fa00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302460.666438:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac6f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666445:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac6f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666457:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:0.0:1789302460.666460:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302460.666464:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac6f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666469:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538fa00/0x1ff82925bd39ac6f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666479:0:18366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666485:0:18366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666490:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666495:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b5348e00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:0.0:1789302460.666503:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666509:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666516:0:18366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:0.0:1789302460.666519:0:18366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789302460.666521:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.666526:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5348e00/0x1ff82925bd39ac61 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302460.666690:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+18:15691:x1876219101588864:12345-192.168.203.9@tcp:57:lhsmtool_posix.0 Request processed in 42410us (42703us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1789302460.666700:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 70 00000020:00080000:0.0:1789302460.666705:0:18366:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789302460.667220:0:17144:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789302460.667225:0:17144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789302460.667243:0:17144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789302460.667249:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789302460.667556:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101589248 00000100:00100000:3.0:1789302460.667564:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101589248 00000100:00100000:3.0:1789302460.667623:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:3.0:1789302460.667634:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+18:15690:x1876219101589248:12345-192.168.203.9@tcp:49:bash.0 00000100:00100000:3.0:1789302460.667740:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+18:15690:x1876219101589248:12345-192.168.203.9@tcp:49:bash.0 Request processed in 108us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302460.667747:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 12 00000100:00100000:3.0:1789302460.674973:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302460.675160:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101589376 00000100:00100000:0.0:1789302460.675171:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101589376 00000100:00100000:0.0:1789302460.675230:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:0.0:1789302460.675241:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+7:15690:x1876219101589376:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:0.0:1789302460.675259:0:18618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302460.675282:0:18618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fea0594/0x1ff82925bd39ac76 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5fd0 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302460.675309:0:18618:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa696bc, atime: 0x6aa696ba, ctime: 0x6aa696bc, blocks: 0x0 00010000:00010000:0.0:1789302460.675332:0:18618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=536s v=(0 0) 00010000:00010000:0.0:1789302460.675338:0:18618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302460.675365:0:18618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fea0594/0x1ff82925bd39ac76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fd0 expref: 8 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.675381:0:18618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fea0594/0x1ff82925bd39ac76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fd0 expref: 8 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.675407:0:18618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b538fa00, rc 0) 00000100:00100000:0.0:1789302460.675475:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+8:15690:x1876219101589376:12345-192.168.203.9@tcp:101:bash.0 Request processed in 236us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302460.675482:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:3.0:1789302460.675832:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.678782:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.678881:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101589760 00000100:00100000:1.0:1789302460.678892:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101589760 00000100:00100000:1.0:1789302460.678955:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 71 00000100:00100000:1.0:1789302460.678965:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+18:15690:x1876219101589760:12345-192.168.203.9@tcp:101:bash.0 00010000:00010000:1.0:1789302460.678999:0:17111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302460.679019:0:17111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aac00/0x1ff82925bd39ac7d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5fd7 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302460.679060:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101589632 00000100:00100000:0.0:1789302460.679066:0:17113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101589632 00010000:00010000:1.0:1789302460.679081:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ac84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.679097:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ac84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.679109:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ac84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302460.679143:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 13 00000100:00100000:0.0:1789302460.679155:0:17113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc485dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+20:15691:x1876219101589632:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 00010000:00010000:1.0:1789302460.679258:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aac00/0x1ff82925bd39ac7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fd7 expref: 21 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.679278:0:17111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839ab600/0x1ff82925bd39ac84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fd7 expref: 20 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.679286:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302460.679290:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302460.679293:0:17111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc3839ab600, rc 0) 00000100:00100000:1.0:1789302460.679346:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+21:15690:x1876219101589760:12345-192.168.203.9@tcp:101:bash.0 Request processed in 382us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302460.679352:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 71 00000004:00080000:0.0:1789302460.679470:0:17113:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789302460.679501:0:17113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1789302460.679526:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39ac8b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.679537:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39ac8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.679546:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39ac8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.679554:0:17113:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39ac8b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.679560:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39ac8b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.679574:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39ac8b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302460.679597:0:17113:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789302460.679652:0:17113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc485dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+21:15691:x1876219101589632:12345-192.168.203.9@tcp:35:lhsmtool_posix.0 Request processed in 498us (3821us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1789302460.679660:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 13 00000020:00080000:0.0:1789302460.679663:0:17113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789302460.680761:0:17099:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302460.680770:0:17099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39ac8b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.680779:0:17099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc4b538e800 already unused, calling callback (ffffffffc0dce8b0) 00010000:00010000:1.0:1789302460.680783:0:17099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39ac8b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.680808:0:17099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39ac8b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.680822:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cc381fa3f00) 00010000:00010000:1.0:1789302460.680825:0:17099:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789302460.680830:0:17099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39ac8b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.680836:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b538e800/0x1ff82925bd39ac8b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.680851:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302460.680853:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302460.680855:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302460.696308:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302460.696410:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101590016 00000100:00100000:0.0:1789302460.696419:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101590016 00000100:00100000:0.0:1789302460.696471:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 14 00000100:00100000:0.0:1789302460.696481:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+21:15690:x1876219101590016:12345-192.168.203.9@tcp:35:bash.0 00000001:00080000:0.0:1789302460.696736:0:17114:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:0.0:1789302460.696839:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+23:15690:x1876219101590016:12345-192.168.203.9@tcp:35:bash.0 Request processed in 358us (539us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1789302460.696846:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 14 00000020:00080000:0.0:1789302460.696851:0:17114:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789302460.856208:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:2.0:1789302460.856337:0:17110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101590272 00000100:00100000:2.0:1789302460.856347:0:17110:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101590272 00000100:00100000:2.0:1789302460.856405:0:17110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:2.0:1789302460.856416:0:17110:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+23:15701:x1876219101590272:12345-192.168.203.9@tcp:101:lfs.0 00010000:00010000:2.0:1789302460.856451:0:17110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302460.856472:0:17110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe9f2be4c799a5fde expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302460.856696:0:17110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789302460.856800:0:17110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fde expref: 25 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.856813:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cc383963600) 00010000:00010000:2.0:1789302460.856816:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302460.856822:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc4b5349400/0x1ff82925bd39ac92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.9@tcp remote: 0xe9f2be4c799a5fde expref: 25 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302460.856836:0:17110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cc4b5349400, rc 0) 00000100:00100000:2.0:1789302460.857045:0:17110:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+24:15701:x1876219101590272:12345-192.168.203.9@tcp:101:lfs.0 Request processed in 629us (845us total) trans 8589934633 rc 301/301 00000100:00100000:2.0:1789302460.857071:0:17110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:2.0:1789302460.864222:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302460.864345:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101590400 00000100:00100000:1.0:1789302460.864355:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101590400 00000100:00100000:1.0:1789302460.864458:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 73 00000100:00100000:1.0:1789302460.864468:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+24:15701:x1876219101590400:12345-192.168.203.9@tcp:34:lfs.0 00010000:00010000:1.0:1789302460.864535:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aca0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864549:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aca0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864569:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aca0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864582:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aca7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864605:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aca7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864611:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aca7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864683:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39acae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864692:0:17111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39acae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864699:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39acae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302460.864743:0:17111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39acae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864755:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aca0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864760:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aca0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864767:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aca0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864773:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aba00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302460.864777:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aca0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864785:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aca0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864803:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cc381fa8a00) 00010000:00010000:1.0:1789302460.864805:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302460.864811:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aca0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864817:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aba00/0x1ff82925bd39aca0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864830:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aca7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864836:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aca7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864842:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aca7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864847:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aaa00 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302460.864850:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aca7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864856:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aca7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864862:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cc383963c00) 00010000:00010000:1.0:1789302460.864864:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302460.864867:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aca7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864872:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aaa00/0x1ff82925bd39aca7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864897:0:17111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39acae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864903:0:17111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39acae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864909:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39acae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864914:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cc3839aa200 already unused, calling callback (ffffffffc19e04f0) 00010000:00010000:1.0:1789302460.864917:0:17111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39acae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864922:0:17111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39acae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864929:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cc381fa8600) 00010000:00010000:1.0:1789302460.864931:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302460.864934:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39acae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302460.864940:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cc3839aa200/0x1ff82925bd39acae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17111 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302460.865036:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+24:15701:x1876219101590400:12345-192.168.203.9@tcp:34:lfs.0 Request processed in 568us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302460.865044:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 73 00000100:00100000:2.0:1789302460.868930:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302460.869020:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101590656 00000100:00100000:0.0:1789302460.869030:0:17114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101590656 00000100:00100000:0.0:1789302460.869083:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 15 00000100:00100000:0.0:1789302460.869093:0:17114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+24:15701:x1876219101590656:12345-192.168.203.9@tcp:35:lfs.0 00000100:00100000:0.0:1789302460.869324:0:17114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9f958801-6e12-44ad-8390-fe02a2305ca5+25:15701:x1876219101590656:12345-192.168.203.9@tcp:35:lfs.0 Request processed in 231us (402us total) trans 8589934634 rc 0/0 00000100:00100000:0.0:1789302460.869332:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 15 00010000:00010000:0.0:1789302460.948589:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302461.012376:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121591808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789302461.012440:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121592064:0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.012484:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302461.012492:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302461.012522:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121592576:0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.012532:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121592320:0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.012548:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302461.012604:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc485dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121591680:0@lo:400:kworker.0 00000100:00100000:2.0:1789302461.012677:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121591808 00000100:00100000:2.0:1789302461.012685:0:18620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121591808 00000100:00100000:2.0:1789302461.012740:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789302461.012750:0:18620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121591808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789302461.012777:0:18620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789302461.017261:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121593088:0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.017329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302461.017428:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121592064 00000100:00100000:3.0:1789302461.017436:0:18617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121592064 00000100:00100000:3.0:1789302461.017487:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121592576 00000100:00100000:3.0:1789302461.017491:0:18617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121592576 00000100:00100000:3.0:1789302461.017519:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789302461.017528:0:18617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121592064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.017584:0:18617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876219121592064:12345-0@lo:400:kworker.0 Request processed in 56us (5092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302461.017591:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789302461.017610:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789302461.017616:0:18617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121592576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.017646:0:18617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121592576:12345-0@lo:400:kworker.0 Request processed in 30us (5099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302461.017653:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789302461.017692:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876219121592064:0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.017703:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121592576:0@lo:400:kworker.0 00000100:00080000:3.0:1789302461.017734:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789302461.017738:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302461.018157:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121591936:0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.018193:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302461.018235:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121592448:0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.018258:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302461.018275:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121592960:0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.018296:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302461.018313:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121593472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302461.018334:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302461.018362:0:18621:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789302461.018370:0:18621:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789302461.018389:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121591936 00000100:00100000:3.0:1789302461.018393:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121591936 00000100:00100000:3.0:1789302461.018417:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121592448 00000100:00100000:3.0:1789302461.018419:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121592448 00000100:00100000:3.0:1789302461.018434:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789302461.018441:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121591936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.018480:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876219121591936:12345-0@lo:400:kworker.0 Request processed in 39us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302461.018486:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789302461.018500:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789302461.018506:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121592448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.018533:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876219121592448:12345-0@lo:400:kworker.0 Request processed in 28us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302461.018539:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789302461.018566:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121591936:0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.018575:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876219121592448:0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.018597:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121593088 00000100:00100000:3.0:1789302461.018600:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121593088 00000100:00080000:3.0:1789302461.018622:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789302461.018649:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121592960 00000100:00100000:3.0:1789302461.018652:0:17112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121592960 00000100:00080000:3.0:1789302461.018664:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302461.018683:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789302461.018690:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121593088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.018727:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876219121593088:12345-0@lo:400:kworker.0 Request processed in 37us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302461.018732:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1789302461.018915:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc48838e300 x1876219121593088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302461.018927:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876219121593088:0@lo:400:kworker.0 00000100:00100000:3.0:1789302461.018948:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789302461.018955:0:17112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121592960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302461.020315:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302461.020368:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121592192:0@lo:400:kworker.0 00000100:00100000:1.0:1789302461.020397:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302461.020421:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121592704:0@lo:400:kworker.0 00000100:00100000:1.0:1789302461.020440:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302461.020457:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121593216:0@lo:400:kworker.0 00000100:00100000:1.0:1789302461.020476:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302461.020502:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121593216 00000100:00100000:1.0:1789302461.020508:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121593216 00000100:00100000:1.0:1789302461.020546:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789302461.020553:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121593216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302461.020591:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876219121593216:12345-0@lo:400:kworker.0 Request processed in 38us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302461.020597:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789302461.020629:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876219121593216:0@lo:400:kworker.0 00000100:00080000:1.0:1789302461.020681:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302461.020691:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121592192 00000100:00100000:1.0:1789302461.020694:0:18617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121592192 00000100:00100000:1.0:1789302461.020714:0:18617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121592704 00000100:00100000:1.0:1789302461.020717:0:18617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121592704 00000100:00100000:1.0:1789302461.020733:0:18617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789302461.020739:0:18617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1876219121592192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.023481:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302461.023547:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121592832:0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.023602:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302461.023614:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121593344:0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.023636:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302461.023678:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121592320 00000100:00100000:0.0:1789302461.023686:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121592320 00000100:00100000:0.0:1789302461.023719:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121592832 00000100:00100000:0.0:1789302461.023723:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121592832 00000100:00100000:0.0:1789302461.023734:0:17111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121593344 00000100:00100000:0.0:1789302461.023736:0:17111:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121593344 00000100:00080000:0.0:1789302461.023757:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789302461.023775:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789302461.023782:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121592320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.023827:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876219121592320:12345-0@lo:400:kworker.0 Request processed in 46us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302461.023834:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789302461.023848:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789302461.023853:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121592832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.023873:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876219121592832:12345-0@lo:400:kworker.0 Request processed in 20us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302461.023878:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789302461.023887:0:17111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789302461.023892:0:17111:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121593344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.023925:0:17111:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876219121593344:12345-0@lo:400:kworker.0 Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302461.023931:0:17111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789302461.023960:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876219121592320:0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.023969:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876219121592832:0@lo:400:kworker.0 00010000:00080000:0.0:1789302461.023978:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cc48838df80 x1876219121593344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302461.024000:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876219121593344:0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.024053:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789302461.024061:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1876219121592704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.024094:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1876219121592704:12345-0@lo:400:kworker.0 Request processed in 35us (3653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302461.024099:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789302461.024148:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876219121592704:0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.024205:0:17102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121591680 00000100:00100000:0.0:1789302461.024209:0:17102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121591680 00000100:00100000:0.0:1789302461.024238:0:17102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789302461.024244:0:17102:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:3648:x1876219121591680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.024277:0:17102:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c46098ed-e570-4ba8-9393-0223b90f3f6e+24:3648:x1876219121591680:12345-0@lo:400:kworker.0 Request processed in 32us (3965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302461.024297:0:17102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789302461.024330:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc485dd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c46098ed-e570-4ba8-9393-0223b90f3f6e:3648:1876219121591680:0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.024360:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121593472 00000100:00100000:0.0:1789302461.024371:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121593472 00000100:00100000:0.0:1789302461.024464:0:20248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789302461.024471:0:20248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3646:x1876219121593472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302461.024486:0:20248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789302461.024524:0:20248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3646:x1876219121593472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (6188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302461.024529:0:20248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789302461.024580:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876219121593472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302461.024931:0:18620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876219121591808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12180us (12447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302461.024939:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789302461.026827:0:17112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876219121592960:12345-0@lo:400:kworker.0 Request processed in 7865us (8521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302461.026841:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789302461.027433:0:18617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1876219121592192:12345-0@lo:400:kworker.0 Request processed in 6691us (7032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302461.027443:0:18617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789302461.028165:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc384295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121592192:0@lo:400:kworker.0 00000100:00100000:2.0:1789302461.028621:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876219121592960:0@lo:400:kworker.0 00000100:00100000:0.0:1789302461.031131:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876219121591808:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789302461.972479:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302462.294819:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302462.294874:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302462.294915:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302462.294952:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302462.294990:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302462.295015:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302462.295045:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302462.295080:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101591040 00000100:00100000:3.0:1789302462.295141:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101591040 00000100:00100000:3.0:1789302462.295220:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101591552 00000100:00100000:3.0:1789302462.295224:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101591552 00000100:00100000:3.0:1789302462.295240:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101590912 00000100:00100000:3.0:1789302462.295242:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101590912 00000100:00100000:3.0:1789302462.295265:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 70 00000100:00100000:3.0:1789302462.295276:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2399:x1876219101591040:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302462.295379:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2399:x1876219101591040:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 104us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302462.295388:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 70 00000100:00100000:3.0:1789302462.295413:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 71 00000100:00100000:3.0:1789302462.295421:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2399:x1876219101591552:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302462.295446:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2399:x1876219101591552:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302462.295452:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 71 00000100:00100000:3.0:1789302462.295463:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:3.0:1789302462.295469:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+25:2399:x1876219101590912:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302462.295519:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+25:2399:x1876219101590912:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 49us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302462.295526:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 72 00000100:00100000:3.0:1789302462.295548:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101591296 00000100:00100000:3.0:1789302462.295552:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101591296 00000100:00100000:3.0:1789302462.295578:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101591808 00000100:00100000:3.0:1789302462.295581:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101591808 00000100:00100000:3.0:1789302462.295592:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101591168 00000100:00100000:3.0:1789302462.295594:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101591168 00000100:00100000:3.0:1789302462.295609:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 28 00000100:00100000:3.0:1789302462.295625:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+8:2399:x1876219101591296:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302462.295653:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+8:2399:x1876219101591296:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 30us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302462.295659:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 28 00000100:00100000:3.0:1789302462.295671:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00100000:3.0:1789302462.295678:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2399:x1876219101591808:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302462.295700:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2399:x1876219101591808:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302462.295706:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 29 00000100:00100000:3.0:1789302462.295717:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00100000:3.0:1789302462.295723:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2399:x1876219101591168:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302462.295745:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9f958801-6e12-44ad-8390-fe02a2305ca5+5:2399:x1876219101591168:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 22us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302462.295750:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 30 00000100:00080000:3.0:1789302462.295768:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789302462.295773:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789302462.295776:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302462.295778:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789302462.296236:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101590784 00000100:00100000:2.0:1789302462.296243:0:17105:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101590784 00000100:00100000:2.0:1789302462.296295:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 167 00000100:00100000:2.0:1789302462.296304:0:17105:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc498aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+13:2399:x1876219101590784:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:2.0:1789302462.296349:0:17105:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc498aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6def970d-8bc0-4857-87d9-88981813c2ca+13:2399:x1876219101590784:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 45us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302462.296356:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 167 00000100:00100000:0.0:1789302462.337472:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:0.0:1789302462.337523:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:3.0:1789302462.337753:0:19064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101591680 00000100:00100000:3.0:1789302462.337767:0:19064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101591680 00000100:00100000:3.0:1789302462.338843:0:19064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:3.0:1789302462.338870:0:19064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2399:x1876219101591680:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302462.339003:0:19064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7faca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+5:2399:x1876219101591680:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 147us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302462.339011:0:19064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 31 00000100:00100000:3.0:1789302462.339263:0:18366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101591424 00000100:00100000:3.0:1789302462.339273:0:18366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101591424 00000100:00080000:0.0:1789302462.345839:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302462.345855:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302462.351253:0:18366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 73 00000100:00100000:3.0:1789302462.351273:0:18366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2399:x1876219101591424:12345-192.168.203.9@tcp:400:kworker.0 00000100:00100000:3.0:1789302462.351385:0:18366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c39c9e8-9b50-402e-a4e7-1190d400118d+6:2399:x1876219101591424:12345-192.168.203.9@tcp:400:kworker.0 Request processed in 118us (13923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302462.351394:0:18366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 73 00000001:02000400:1.0:1789302462.558515:0:20285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1789302463.001436:0:17098:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302463.066394:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc4b7fafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121593600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789302463.066494:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302463.066629:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121593600 00000100:00100000:0.0:1789302463.066640:0:18621:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121593600 00000100:00100000:0.0:1789302463.066730:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789302463.066745:0:18621:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121593600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789302463.066793:0:18621:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789302463.066854:0:18621:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876219121593600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302463.066863:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789302463.066927:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc4b7fafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876219121593600:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789302463.067067:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789302464.020408:0:17099:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302464.097348:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cc48838df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121593728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302464.097441:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302464.097544:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219121593728 00000100:00100000:2.0:1789302464.097555:0:18620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219121593728 00000100:00100000:2.0:1789302464.097640:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789302464.097651:0:18620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc4b7fafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121593728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302464.097679:0:18620:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1789302464.097758:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302464.110169:0:18620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc4b7fafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876219121593728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12508us (12717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302464.110202:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302464.111833:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cc48838df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876219121593728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302464.341015:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000040:00080000:2.0:1789302464.341025:0:17868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789302464.341078:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.9@tcp (source: 12345-192.168.203.9@tcp) 00000100:00100000:1.0:1789302464.341534:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101591936 00000100:00100000:1.0:1789302464.341547:0:18622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101591936 00002000:00100000:1.0:1789302464.341627:0:18622:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff8cc48838d500 x1876219101591936/t0(0) o4->9f958801-6e12-44ad-8390-fe02a2305ca5@192.168.203.9@tcp:40/0 lens 504/0 e 0 to 0 dl 1789302475 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789302464.341640:0:18622:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc48838d500 with x1876219101591936 ext(0->8) 00002000:00010000:1.0:1789302464.341649:0:18622:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cc48838d500 00000100:00100000:1.0:1789302464.341690:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 0 00000100:00100000:1.0:1789302464.341702:0:18622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+8:2396:x1876219101591936:12345-192.168.203.9@tcp:4:bash.0 00000100:00080000:3.0:1789302464.342161:0:17106:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302464.342567:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219101592064 00000100:00100000:1.0:1789302464.342575:0:18618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219101592064 00000100:00100000:1.0:1789302464.342617:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.9@tcp, seq: 32 00000100:00100000:1.0:1789302464.342626:0:18618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cc48838f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+11:2396:x1876219101592064:12345-192.168.203.9@tcp:16:kworker.0 00000100:00100000:2.0:1789302464.349858:0:18622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9f958801-6e12-44ad-8390-fe02a2305ca5+11:2396:x1876219101591936:12345-192.168.203.9@tcp:4:bash.0 Request processed in 8140us (8839us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789302464.349884:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 0 00002000:00100000:2.0:1789302464.349902:0:18622:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff8cc48838d500 x1876219101591936/t8589934599(0) o4->9f958801-6e12-44ad-8390-fe02a2305ca5@192.168.203.9@tcp:40/0 lens 504/448 e 0 to 0 dl 1789302475 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1789302464.349915:0:18622:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cc48838d500 with x1876219101591936 ext(0->8) 00002000:00010000:2.0:1789302464.349925:0:18622:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8cc48838d500 00000001:00080000:2.0:1789302464.354797:0:19430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1789302464.354820:0:19430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:1.0:1789302464.372323:0:18618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cc48838f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9f958801-6e12-44ad-8390-fe02a2305ca5+6:2396:x1876219101592064:12345-192.168.203.9@tcp:16:kworker.0 Request processed in 29680us (31226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302464.372341:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.9@tcp, seq: 32 Debug log: 43624 lines, 43624 kept, 0 dropped, 0 bad.